Date: (Fri) Jun 10, 2016

Introduction:

Data: Source: Training: “https://inclass.kaggle.com/c/can-we-predict-voting-outcomes/download/train2016.csv
New: “https://inclass.kaggle.com/c/can-we-predict-voting-outcomes/download/test2016.csv
Time period:

Synopsis:

Based on analysis utilizing <> techniques, :

Summary of key steps & error improvement stats:

Prediction Accuracy Enhancement Options:

  • transform.data chunk:
    • derive features from multiple features
  • manage.missing.data chunk:
    • Not fill missing vars
    • Fill missing numerics with a different algorithm
    • Fill missing chars with data based on clusters

[](.png)

Potential next steps include:

  • Organization:
    • Categorize by chunk
    • Priority criteria:
      1. Ease of change
      2. Impacts report
      3. Cleans innards
      4. Bug report
  • all chunks:
    • at chunk-end rm(!glb_)
  • manage.missing.data chunk:
    • cleaner way to manage re-splitting of training vs. new entity
  • extract.features chunk:
    • Add n-grams for glbFeatsText
      • “RTextTools”, “tau”, “RWeka”, and “textcat” packages
  • fit.models chunk:
    • Classification: Plot AUC Curves for all models & highlight glbMdlSel
    • Prediction accuracy scatter graph:
    • Add tiles (raw vs. PCA)
    • Use shiny for drop-down of “important” features
    • Use plot.ly for interactive plots ?

    • Change .fit suffix of model metrics to .mdl if it’s data independent (e.g. AIC, Adj.R.Squared - is it truly data independent ?, etc.)
    • create a custom model for rpart that has minbucket as a tuning parameter
    • varImp for randomForest crashes in caret version:6.0.41 -> submit bug report

  • Probability handling for multinomials vs. desired binomial outcome
  • ROCR currently supports only evaluation of binary classification tasks (version 1.0.7)
  • extensions toward multiclass classification are scheduled for the next release

  • fit.all.training chunk:
    • myplot_prediction_classification: displays ‘x’ instead of ‘+’ when there are no prediction errors
  • Compare glb_sel_mdl vs. glb_fin_mdl:
    • varImp
    • Prediction differences (shd be minimal ?)
  • Move glb_analytics_diag_plots to mydsutils.R: (+) Easier to debug (-) Too many glb vars used
  • Add print(ggplot.petrinet(glb_analytics_pn) + coord_flip()) at the end of every major chunk
  • Parameterize glb_analytics_pn
  • Move glb_impute_missing_data to mydsutils.R: (-) Too many glb vars used; glb_<>_df reassigned
  • Do non-glm methods handle interaction terms ?
  • f-score computation for classifiers should be summation across outcomes (not just the desired one ?)
  • Add accuracy computation to glb_dmy_mdl in predict.data.new chunk
  • Why does splitting fit.data.training.all chunk into separate chunks add an overhead of ~30 secs ? It’s not rbind b/c other chunks have lower elapsed time. Is it the number of plots ?
  • Incorporate code chunks in print_sessionInfo
  • Test against
    • projects in github.com/bdanalytics
    • lectures in jhu-datascience track

Analysis:

rm(list = ls())
set.seed(12345)
options(stringsAsFactors = FALSE)
source("~/Dropbox/datascience/R/mycaret.R")
source("~/Dropbox/datascience/R/mypetrinet.R")
source("~/Dropbox/datascience/R/myplclust.R")
source("~/Dropbox/datascience/R/myplot.R")
source("~/Dropbox/datascience/R/myscript.R")
source("~/Dropbox/datascience/R/mytm.R")
if (is.null(knitr::opts_current$get(name = 'label'))) # Running in IDE
    debugSource("~/Dropbox/datascience/R/mydsutils.R") else
    source("~/Dropbox/datascience/R/mydsutils.R")    
## Loading required package: caret
## Loading required package: lattice
# Gather all package requirements here
suppressPackageStartupMessages(require(doMC))
glbCores <- 10 # of cores on machine - 2
registerDoMC(glbCores) 

suppressPackageStartupMessages(require(caret))
require(plyr)
## Loading required package: plyr
require(dplyr)
## Loading required package: dplyr
## 
## Attaching package: 'dplyr'
## The following objects are masked from 'package:plyr':
## 
##     arrange, count, desc, failwith, id, mutate, rename, summarise,
##     summarize
## The following objects are masked from 'package:stats':
## 
##     filter, lag
## The following objects are masked from 'package:base':
## 
##     intersect, setdiff, setequal, union
require(knitr)
## Loading required package: knitr
require(stringr)
## Loading required package: stringr
#source("dbgcaret.R")
#packageVersion("snow")
#require(sos); findFn("cosine", maxPages=2, sortby="MaxScore")

# Analysis control global variables
# Inputs
#   url/name = "<PathPointer>"; if url specifies a zip file, name = "<filename>"; 
#               or named collection of <PathPointer>s
#   sep = choose from c(NULL, "\t")
glbObsTrnFile <- list(url = "https://inclass.kaggle.com/c/can-we-predict-voting-outcomes/download/train2016.csv"
    # or list(url = c(NULL, <.inp1> = "<path1>", <.inp2> = "<path2>"))
    #, splitSpecs = list(method = "copy" # default when glbObsNewFile is NULL
    #                       select from c("copy", NULL ???, "condition", "sample", )
    #                      ,nRatio = 0.3 # > 0 && < 1 if method == "sample" 
    #                      ,seed = 123 # any integer or glbObsTrnPartitionSeed if method == "sample" 
    #                      ,condition = # or 'is.na(<var>)'; '<var> <condition_operator> <value>'    
    #                      )
    )                   
 
glbObsNewFile <- list(url = "https://inclass.kaggle.com/c/can-we-predict-voting-outcomes/download/test2016.csv") 

glbObsDropCondition <- NULL # : default
#   enclose in single-quotes b/c condition might include double qoutes
#       use | & ; NOT || &&    
#   '<condition>' 
    # 'grepl("^First Draft Video:", glbObsAll$Headline)'
    # 'is.na(glbObsAll[, glb_rsp_var_raw])'
    # '(is.na(glbObsAll[, glb_rsp_var_raw]) & grepl("Train", glbObsAll[, glbFeatsId]))'
    # 'is.na(strptime(glbObsAll[, "Date"], glbFeatsDateTime[["Date"]]["format"], tz = glbFeatsDateTime[["Date"]]["timezone"]))'
#nrow(do.call("subset",list(glbObsAll, parse(text=paste0("!(", glbObsDropCondition, ")")))))
    
glb_obs_repartition_train_condition <- NULL # : default
#    "<condition>" 

glb_max_fitobs <- NULL # or any integer
glbObsTrnPartitionSeed <- 123 # or any integer
                         
glb_is_regression <- FALSE; glb_is_classification <- !glb_is_regression; 
    glb_is_binomial <- TRUE # or TRUE or FALSE

glb_rsp_var_raw <- "Party"

# for classification, the response variable has to be a factor
glb_rsp_var <- "Party.fctr"

# if the response factor is based on numbers/logicals e.g (0/1 OR TRUE/FALSE vs. "A"/"B"), 
#   or contains spaces (e.g. "Not in Labor Force")
#   caret predict(..., type="prob") crashes
glb_map_rsp_raw_to_var <- #NULL 
function(raw) {
#     return(raw ^ 0.5)
#     return(log(raw))
#     return(log(1 + raw))
#     return(log10(raw)) 
#     return(exp(-raw / 2))
#     
# chk ref value against frequencies vs. alpha sort order
    ret_vals <- rep_len(NA, length(raw)); ret_vals[!is.na(raw)] <- ifelse(raw[!is.na(raw)] == "Republican", "R", "D"); return(relevel(as.factor(ret_vals), ref = "D")) 
    
#     as.factor(paste0("B", raw))
#     as.factor(gsub(" ", "\\.", raw))
    }

#if glb_rsp_var_raw is numeric:
#print(summary(glbObsAll[, glb_rsp_var_raw]))
#glb_map_rsp_raw_to_var(tst <- c(NA, as.numeric(summary(glbObsAll[, glb_rsp_var_raw])))) 

#if glb_rsp_var_raw is character:
#print(table(glbObsAll[, glb_rsp_var_raw], useNA = "ifany"))
# print(table(glb_map_rsp_raw_to_var(tst <- glbObsAll[, glb_rsp_var_raw]), useNA = "ifany"))

glb_map_rsp_var_to_raw <- #NULL 
function(var) {
#     return(var ^ 2.0)
#     return(exp(var))
#     return(10 ^ var) 
#     return(-log(var) * 2)
#     as.numeric(var)
#     levels(var)[as.numeric(var)]
    sapply(levels(var)[as.numeric(var)], function(elm) 
        if (is.na(elm)) return(elm) else
        if (elm == 'R') return("Republican") else
        if (elm == 'D') return("Democrat") else
        stop("glb_map_rsp_var_to_raw: unexpected value: ", elm)
        )  
#     gsub("\\.", " ", levels(var)[as.numeric(var)])
#     c("<=50K", " >50K")[as.numeric(var)]
#     c(FALSE, TRUE)[as.numeric(var)]
}
# print(table(glb_map_rsp_var_to_raw(glb_map_rsp_raw_to_var(tst)), useNA = "ifany"))

if ((glb_rsp_var != glb_rsp_var_raw) && is.null(glb_map_rsp_raw_to_var))
    stop("glb_map_rsp_raw_to_var function expected")

# List info gathered for various columns
# <col_name>:   <description>; <notes>
# USER_ID - an anonymous id unique to a given user
# YOB - the year of birth of the user
# Gender - the gender of the user, either Male or Female
# Income - the household income of the user. Either not provided, or one of "under $25,000", "$25,001 - $50,000", "$50,000 - $74,999", "$75,000 - $100,000", "$100,001 - $150,000", or "over $150,000".
# HouseholdStatus - the household status of the user. Either not provided, or one of "Domestic Partners (no kids)", "Domestic Partners (w/kids)", "Married (no kids)", "Married (w/kids)", "Single (no kids)", or "Single (w/kids)".
# EducationalLevel - the education level of the user. Either not provided, or one of "Current K-12", "High School Diploma", "Current Undergraduate", "Associate's Degree", "Bachelor's Degree", "Master's Degree", or "Doctoral Degree".
# Party - the political party for whom the user intends to vote for. Either "Democrat" or "Republican
# Q124742, Q124122, . . . , Q96024 - 101 different questions that the users were asked on Show of Hands. If the user didn't answer the question, there is a blank. For information about the question text and possible answers, see the file Questions.pdf.

# currently does not handle more than 1 column; consider concatenating multiple columns
# If glbFeatsId == NULL, ".rownames <- as.numeric(row.names())" is the default
glbFeatsId <- "USER_ID" # choose from c(NULL : default, "<id_feat>") 
# glbFeatsCategory <- "Hhold.fctr" # choose from c(NULL : default, "<category_feat>")
glbFeatsCategory <- "Q109244.fctr" # choose from c(NULL : default, "<category_feat>") -> OOB performed worse than "Hhold.fctr"

# User-specified exclusions
glbFeatsExclude <- c(NULL
#   Feats that shd be excluded due to known causation by prediction variable
# , "<feat1", "<feat2>"
#   Feats that are factors with unique values (as % of nObs) > 49 (empirically derived)
#   Feats that are linear combinations (alias in glm)
#   Feature-engineering phase -> start by excluding all features except id & category & 
#       work each one in
    , "USER_ID", "YOB", "Gender", "Income", "HouseholdStatus", "EducationLevel" 
    ,"Q124742","Q124122" 
    ,"Q123621","Q123464"
    ,"Q122771","Q122770","Q122769","Q122120"
    ,"Q121700","Q121699","Q121011"
    ,"Q120978","Q120650","Q120472","Q120379","Q120194","Q120014","Q120012" 
    ,"Q119851","Q119650","Q119334"
    ,"Q118892","Q118237","Q118233","Q118232","Q118117"
    ,"Q117193","Q117186"
    ,"Q116797","Q116881","Q116953","Q116601","Q116441","Q116448","Q116197"
    ,"Q115602","Q115777","Q115610","Q115611","Q115899","Q115390","Q115195"
    ,"Q114961","Q114748","Q114517","Q114386","Q114152"
    ,"Q113992","Q113583","Q113584","Q113181"
    ,"Q112478","Q112512","Q112270"
    ,"Q111848","Q111580","Q111220"
    ,"Q110740"
    ,"Q109367","Q109244"
    ,"Q108950","Q108855","Q108617","Q108856","Q108754","Q108342","Q108343"
    ,"Q107869","Q107491"
    ,"Q106993","Q106997","Q106272","Q106388","Q106389","Q106042"
    ,"Q105840","Q105655"
    ,"Q104996"
    ,"Q103293"
    ,"Q102906","Q102674","Q102687","Q102289","Q102089"
    ,"Q101162","Q101163","Q101596"
    ,"Q100689","Q100680","Q100562","Q100010"
    ,"Q99982"
    ,"Q99716"
    ,"Q99581"
    ,"Q99480"
    ,"Q98869"
    ,"Q98578"
    ,"Q98197"
    ,"Q98059","Q98078"
    ,"Q96024" # Done
    ,".pos") 
if (glb_rsp_var_raw != glb_rsp_var)
    glbFeatsExclude <- union(glbFeatsExclude, glb_rsp_var_raw)                    

glbFeatsInteractionOnly <- list()
#glbFeatsInteractionOnly[["<child_feat>"]] <- "<parent_feat>"
glbFeatsInteractionOnly[["YOB.Age.dff"]] <- "YOB.Age.fctr"

glbFeatsDrop <- c(NULL
                # , "<feat1>", "<feat2>"
                )

glb_map_vars <- NULL # or c("<var1>", "<var2>")
glb_map_urls <- list();
# glb_map_urls[["<var1>"]] <- "<var1.url>"

# Derived features; Use this mechanism to cleanse data ??? Cons: Data duplication ???
glbFeatsDerive <- list();

# glbFeatsDerive[["<feat.my.sfx>"]] <- list(
#     mapfn = function(<arg1>, <arg2>) { return(function(<arg1>, <arg2>)) } 
#   , args = c("<arg1>", "<arg2>"))
#myprint_df(data.frame(ImageId = mapfn(glbObsAll$.src, glbObsAll$.pos)))
#data.frame(ImageId = mapfn(glbObsAll$.src, glbObsAll$.pos))[7045:7055, ]

    # character
#     mapfn = function(Education) { raw <- Education; raw[is.na(raw)] <- "NA.my"; return(as.factor(raw)) } 
#     mapfn = function(Week) { return(substr(Week, 1, 10)) }
#     mapfn = function(Name) { return(sapply(Name, function(thsName) 
#                                             str_sub(unlist(str_split(thsName, ","))[1], 1, 1))) } 

#     mapfn = function(descriptor) { return(plyr::revalue(descriptor, c(
#         "ABANDONED BUILDING"  = "OTHER",
#         "**"                  = "**"
#                                           ))) }

#     mapfn = function(description) { mod_raw <- description;
    # This is here because it does not work if it's in txt_map_filename
#         mod_raw <- gsub(paste0(c("\n", "\211", "\235", "\317", "\333"), collapse = "|"), " ", mod_raw)
    # Don't parse for "." because of ".com"; use customized gsub for that text
#         mod_raw <- gsub("(\\w)(!|\\*|,|-|/)(\\w)", "\\1\\2 \\3", mod_raw);
    # Some state acrnoyms need context for separation e.g. 
    #   LA/L.A. could either be "Louisiana" or "LosAngeles"
        # modRaw <- gsub("\\bL\\.A\\.( |,|')", "LosAngeles\\1", modRaw);
    #   OK/O.K. could either be "Oklahoma" or "Okay"
#         modRaw <- gsub("\\bACA OK\\b", "ACA OKay", modRaw); 
#         modRaw <- gsub("\\bNow O\\.K\\.\\b", "Now OKay", modRaw);        
    #   PR/P.R. could either be "PuertoRico" or "Public Relations"        
        # modRaw <- gsub("\\bP\\.R\\. Campaign", "PublicRelations Campaign", modRaw);        
    #   VA/V.A. could either be "Virginia" or "VeteransAdministration"        
        # modRaw <- gsub("\\bthe V\\.A\\.\\:", "the VeteranAffairs:", modRaw);
    #   
    # Custom mods

#         return(mod_raw) }

    # numeric
# Create feature based on record position/id in data   
glbFeatsDerive[[".pos"]] <- list(
    mapfn = function(raw1) { return(1:length(raw1)) }
    , args = c(".rnorm"))
# glbFeatsDerive[[".pos.y"]] <- list(
#     mapfn = function(raw1) { return(1:length(raw1)) }       
#     , args = c(".rnorm"))    

# Add logs of numerics that are not distributed normally
#   Derive & keep multiple transformations of the same feature, if normality is hard to achieve with just one transformation
#   Right skew: logp1; sqrt; ^ 1/3; logp1(logp1); log10; exp(-<feat>/constant)
# glbFeatsDerive[["WordCount.log1p"]] <- list(
#     mapfn = function(WordCount) { return(log1p(WordCount)) } 
#   , args = c("WordCount"))
# glbFeatsDerive[["WordCount.root2"]] <- list(
#     mapfn = function(WordCount) { return(WordCount ^ (1/2)) } 
#   , args = c("WordCount"))
# glbFeatsDerive[["WordCount.nexp"]] <- list(
#     mapfn = function(WordCount) { return(exp(-WordCount)) } 
#   , args = c("WordCount"))
#print(summary(glbObsAll$WordCount))
#print(summary(mapfn(glbObsAll$WordCount)))
    
# If imputation shd be skipped for this feature
# glbFeatsDerive[["District.fctr"]] <- list(
#     mapfn = function(District) {
#         raw <- District;
#         ret_vals <- rep_len("NA", length(raw)); 
#         ret_vals[!is.na(raw)] <- sapply(raw[!is.na(raw)], function(elm) 
#                                         ifelse(elm < 10, "1-9", 
#                                         ifelse(elm < 20, "10-19", "20+")));
#         return(relevel(as.factor(ret_vals), ref = "NA"))
#     }       
#     , args = c("District"))    

# YOB options:
# 1. Missing data:
# 1.1   0 -> Does not improve baseline
# 1.2   Cut factors & "NA" is a level
# 2. Data corrections: < 1928 & > 2000
# 3. Scale YOB
# 4. Add Age
# YOB.Age.fctr needs to be synced with YOB.Age.dff; Create a separate sub-function ???
glbFeatsDerive[["YOB.Age.fctr"]] <- list(
    mapfn = function(raw1) {
        raw <- 2016 - raw1 
        # raw[!is.na(raw) & raw >= 2010] <- NA
        raw[!is.na(raw) & (raw <= 15)] <- NA
        raw[!is.na(raw) & (raw >= 90)] <- NA        
        retVal <- rep_len("NA", length(raw))
        # breaks = c(1879, seq(1949, 1989, 10), 2049)
        # cutVal <- cut(raw[!is.na(raw)], breaks = breaks, 
        #               labels = as.character(breaks + 1)[1:(length(breaks) - 1)])
        cutVal <- cut(raw[!is.na(raw)], breaks = c(15, 20, 25, 30, 35, 40, 50, 65, 90))
        retVal[!is.na(raw)] <- levels(cutVal)[cutVal]
        return(factor(retVal, levels = c("NA"
                ,"(15,20]","(20,25]","(25,30]","(30,35]","(35,40]","(40,50]","(50,65]","(65,90]"),
                        ordered = TRUE))
    }
    , args = c("YOB"))

# YOB.Age.fctr needs to be synced with YOB.Age.dff; Create a separate sub-function ???
glbFeatsDerive[["YOB.Age.dff"]] <- list(
    mapfn = function(raw1) {
        raw <- 2016 - raw1 
        raw[!is.na(raw) & (raw <= 15)] <- NA
        raw[!is.na(raw) & (raw >= 90)] <- NA        
        breaks <- c(15, 20, 25, 30, 35, 40, 50, 65, 90)

        # retVal <- rep_len(0, length(raw))
        stopifnot(sum(!is.na(raw) && (raw <= 15)) == 0)
        stopifnot(sum(!is.na(raw) && (raw >= 90)) == 0) 
        # msk <- !is.na(raw) && (raw > 15) && (raw <= 20); if (sum(msk > 0)) retVal[msk] <- raw[msk] - 15
        # msk <- !is.na(raw) && (raw > 20) && (raw <= 25); if (sum(msk > 0)) retVal[msk] <- raw[msk] - 20
        # msk <- !is.na(raw) && (raw > 25) && (raw <= 30); if (sum(msk > 0)) retVal[msk] <- raw[msk] - 25
        # msk <- !is.na(raw) && (raw > 30) && (raw <= 35); if (sum(msk > 0)) retVal[msk] <- raw[msk] - 30
        # msk <- !is.na(raw) && (raw > 35) && (raw <= 40); if (sum(msk > 0)) retVal[msk] <- raw[msk] - 35
        # msk <- !is.na(raw) && (raw > 40) && (raw <= 50); if (sum(msk > 0)) retVal[msk] <- raw[msk] - 40
        # msk <- !is.na(raw) && (raw > 50) && (raw <= 65); if (sum(msk > 0)) retVal[msk] <- raw[msk] - 50
        # msk <- !is.na(raw) && (raw > 65) && (raw <= 90); if (sum(msk > 0)) retVal[msk] <- raw[msk] - 65

        breaks <- c(15, 20, 25, 30, 35, 40, 50, 65, 90)        
        retVal <- sapply(raw, function(age) {
            if (is.na(age)) return(0) else
            if ((age > 15) && (age <= 20)) return(age - 15) else
            if ((age > 20) && (age <= 25)) return(age - 20) else
            if ((age > 25) && (age <= 30)) return(age - 25) else
            if ((age > 30) && (age <= 35)) return(age - 30) else
            if ((age > 35) && (age <= 40)) return(age - 35) else
            if ((age > 40) && (age <= 50)) return(age - 40) else
            if ((age > 50) && (age <= 65)) return(age - 50) else
            if ((age > 65) && (age <= 90)) return(age - 65)
        })
        
        return(retVal)
    }
    , args = c("YOB"))

glbFeatsDerive[["Gender.fctr"]] <- list(
    mapfn = function(raw1) {
        raw <- raw1
        raw[raw %in% ""] <- "N"
        raw <- gsub("Male"  , "M", raw, fixed = TRUE)
        raw <- gsub("Female", "F", raw, fixed = TRUE)        
        return(relevel(as.factor(raw), ref = "N"))
    }
    , args = c("Gender"))

glbFeatsDerive[["Income.fctr"]] <- list(
    mapfn = function(raw1) { raw <- raw1;
        raw[raw %in% ""] <- "N"
        raw <- gsub("under $25,000"      , "<25K"    , raw, fixed = TRUE)
        raw <- gsub("$25,001 - $50,000"  , "25-50K"  , raw, fixed = TRUE)
        raw <- gsub("$50,000 - $74,999"  , "50-75K"  , raw, fixed = TRUE)
        raw <- gsub("$75,000 - $100,000" , "75-100K" , raw, fixed = TRUE)        
        raw <- gsub("$100,001 - $150,000", "100-150K", raw, fixed = TRUE)
        raw <- gsub("over $150,000"      , ">150K"   , raw, fixed = TRUE)        
        return(factor(raw, levels = c("N","<25K","25-50K","50-75K","75-100K","100-150K",">150K"),
                      ordered = TRUE))
    }
    , args = c("Income"))

glbFeatsDerive[["Hhold.fctr"]] <- list(
    mapfn = function(raw1) { raw <- raw1;
        raw[raw %in% ""] <- "N"
        raw <- gsub("Domestic Partners (no kids)", "PKn", raw, fixed = TRUE)
        raw <- gsub("Domestic Partners (w/kids)" , "PKy", raw, fixed = TRUE)        
        raw <- gsub("Married (no kids)"          , "MKn", raw, fixed = TRUE)
        raw <- gsub("Married (w/kids)"           , "MKy", raw, fixed = TRUE)        
        raw <- gsub("Single (no kids)"           , "SKn", raw, fixed = TRUE)
        raw <- gsub("Single (w/kids)"            , "SKy", raw, fixed = TRUE)        
        return(relevel(as.factor(raw), ref = "N"))
    }
    , args = c("HouseholdStatus"))

glbFeatsDerive[["Edn.fctr"]] <- list(
    mapfn = function(raw1) { raw <- raw1;
        raw[raw %in% ""] <- "N"
        raw <- gsub("Current K-12"         , "K12", raw, fixed = TRUE)
        raw <- gsub("High School Diploma"  , "HSD", raw, fixed = TRUE)        
        raw <- gsub("Current Undergraduate", "CCg", raw, fixed = TRUE)
        raw <- gsub("Associate's Degree"   , "Ast", raw, fixed = TRUE)
        raw <- gsub("Bachelor's Degree"    , "Bcr", raw, fixed = TRUE)        
        raw <- gsub("Master's Degree"      , "Msr", raw, fixed = TRUE)
        raw <- gsub("Doctoral Degree"      , "PhD", raw, fixed = TRUE)        
        return(factor(raw, levels = c("N","K12","HSD","CCg","Ast","Bcr","Msr","PhD"),
                      ordered = TRUE))
    }
    , args = c("EducationLevel"))

# for (qsn in c("Q124742","Q124122"))
# for (qsn in grep("Q12(.{4})(?!\\.fctr)", names(glbObsTrn), value = TRUE, perl = TRUE))
for (qsn in grep("Q", glbFeatsExclude, fixed = TRUE, value = TRUE))    
    glbFeatsDerive[[paste0(qsn, ".fctr")]] <- list(
        mapfn = function(raw1) {
            raw1[raw1 %in% ""] <- "NA"
            rawVal <- unique(raw1)
            
            if (length(setdiff(rawVal, (expVal <- c("NA", "No", "Ys")))) == 0) {
                raw1 <- gsub("Yes", "Ys", raw1, fixed = TRUE)
                if (length(setdiff(rawVal, expVal)) > 0)
                    stop(qsn, " vals: ", paste0(rawVal, collapse = "|"), 
                         " does not match expectation: ", paste0(expVal, collapse = "|"))
            } else
            if (length(setdiff(rawVal, (expVal <- c("NA", "Me", "Circumstances")))) == 0) {
                raw1 <- gsub("Circumstances", "Cs", raw1, fixed = TRUE)
                if (length(setdiff(rawVal, expVal)) > 0)
                    stop(qsn, " vals: ", paste0(rawVal, collapse = "|"), 
                         " does not match expectation: ", paste0(expVal, collapse = "|"))
            } else
            if (length(setdiff(rawVal, (expVal <- c("NA", "Grrr people", "Yay people!")))) == 0) {
                raw1 <- gsub("Grrr people", "Gr", raw1, fixed = TRUE)
                raw1 <- gsub("Yay people!", "Yy", raw1, fixed = TRUE)                
                if (length(setdiff(rawVal, expVal)) > 0)
                    stop(qsn, " vals: ", paste0(rawVal, collapse = "|"), 
                         " does not match expectation: ", paste0(expVal, collapse = "|"))
            } else
            if (length(setdiff(rawVal, (expVal <- c("NA", "Idealist", "Pragmatist")))) == 0) {
                raw1 <- gsub("Idealist"  , "Id", raw1, fixed = TRUE)
                raw1 <- gsub("Pragmatist", "Pr", raw1, fixed = TRUE)                
                if (length(setdiff(rawVal, expVal)) > 0)
                    stop(qsn, " vals: ", paste0(rawVal, collapse = "|"), 
                         " does not match expectation: ", paste0(expVal, collapse = "|"))
            } else
            if (length(setdiff(rawVal, (expVal <- c("NA", "Private", "Public")))) == 0) {
                raw1 <- gsub("Private", "Pt", raw1, fixed = TRUE)
                raw1 <- gsub("Public" , "Pc", raw1, fixed = TRUE)                
                if (length(setdiff(rawVal, expVal)) > 0)
                    stop(qsn, " vals: ", paste0(rawVal, collapse = "|"), 
                         " does not match expectation: ", paste0(expVal, collapse = "|"))
            }
            
            return(relevel(as.factor(raw1), ref = "NA"))
        }
        , args = c(qsn))

# If imputation of missing data is not working ...
# glbFeatsDerive[["FertilityRate.nonNA"]] <- list(
#     mapfn = function(FertilityRate, Region) {
#         RegionMdn <- tapply(FertilityRate, Region, FUN = median, na.rm = TRUE)
# 
#         retVal <- FertilityRate
#         retVal[is.na(FertilityRate)] <- RegionMdn[Region[is.na(FertilityRate)]]
#         return(retVal)
#     }
#     , args = c("FertilityRate", "Region"))
    
#     mapfn = function(HOSPI.COST) { return(cut(HOSPI.COST, 5, breaks = c(0, 100000, 200000, 300000, 900000), labels = NULL)) }     
#     mapfn = function(Rasmussen)  { return(ifelse(sign(Rasmussen) >= 0, 1, 0)) } 
#     mapfn = function(startprice) { return(startprice ^ (1/2)) }       
#     mapfn = function(startprice) { return(log(startprice)) }   
#     mapfn = function(startprice) { return(exp(-startprice / 20)) }
#     mapfn = function(startprice) { return(scale(log(startprice))) }     
#     mapfn = function(startprice) { return(sign(sprice.predict.diff) * (abs(sprice.predict.diff) ^ (1/10))) }        

    # factor      
#     mapfn = function(PropR) { return(as.factor(ifelse(PropR >= 0.5, "Y", "N"))) }
#     mapfn = function(productline, description) { as.factor(gsub(" ", "", productline)) }
#     mapfn = function(purpose) { return(relevel(as.factor(purpose), ref="all_other")) }
#     mapfn = function(raw) { tfr_raw <- as.character(cut(raw, 5)); 
#                             tfr_raw[is.na(tfr_raw)] <- "NA.my";
#                             return(as.factor(tfr_raw)) }
#     mapfn = function(startprice.log10) { return(cut(startprice.log10, 3)) }
#     mapfn = function(startprice.log10) { return(cut(sprice.predict.diff, c(-1000, -100, -10, -1, 0, 1, 10, 100, 1000))) }    

#     , args = c("<arg1>"))
    
    # multiple args
#     mapfn = function(id, date) { return(paste(as.character(id), as.character(date), sep = "#")) }        
#     mapfn = function(PTS, oppPTS) { return(PTS - oppPTS) }
#     mapfn = function(startprice.log10.predict, startprice) {
#                  return(spdiff <- (10 ^ startprice.log10.predict) - startprice) } 
#     mapfn = function(productline, description) { as.factor(
#         paste(gsub(" ", "", productline), as.numeric(nchar(description) > 0), sep = "*")) }
#     mapfn = function(.src, .pos) { 
#         return(paste(.src, sprintf("%04d", 
#                                    ifelse(.src == "Train", .pos, .pos - 7049)
#                                    ), sep = "#")) }       

# # If glbObsAll is not sorted in the desired manner
#     mapfn=function(Week) { return(coredata(lag(zoo(orderBy(~Week, glbObsAll)$ILI), -2, na.pad=TRUE))) }
#     mapfn=function(ILI) { return(coredata(lag(zoo(ILI), -2, na.pad=TRUE))) }
#     mapfn=function(ILI.2.lag) { return(log(ILI.2.lag)) }

# glbFeatsDerive[["<var1>"]] <- glbFeatsDerive[["<var2>"]]

# tst <- "descr.my"; args_lst <- NULL; for (arg in glbFeatsDerive[[tst]]$args) args_lst[[arg]] <- glbObsAll[, arg]; print(head(args_lst[[arg]])); print(head(drv_vals <- do.call(glbFeatsDerive[[tst]]$mapfn, args_lst))); 
# print(which_ix <- which(args_lst[[arg]] == 0.75)); print(drv_vals[which_ix]); 

glbFeatsDateTime <- list()
# Use OlsonNames() to enumerate supported time zones
# glbFeatsDateTime[["<DateTimeFeat>"]] <- 
#     c(format = "%Y-%m-%d %H:%M:%S" or "%m/%e/%y", timezone = "US/Eastern", impute.na = TRUE, 
#       last.ctg = FALSE, poly.ctg = FALSE)

glbFeatsPrice <- NULL # or c("<price_var>")

glbFeatsImage <- list() #list(<imageFeat> = list(patchSize = 10)) # if patchSize not specified, no patch computation

glbFeatsText <- list()
Sys.setlocale("LC_ALL", "C") # For english
## [1] "C/C/C/C/C/en_US.UTF-8"
#glbFeatsText[["<TextFeature>"]] <- list(NULL,
#   ,names = myreplacePunctuation(str_to_lower(gsub(" ", "", c(NULL, 
#       <comma-separated-screened-names>
#   ))))
#   ,rareWords = myreplacePunctuation(str_to_lower(gsub(" ", "", c(NULL, 
#       <comma-separated-nonSCOWL-words>
#   ))))
#)

# Text Processing Step: custom modifications not present in txt_munge -> use glbFeatsDerive
# Text Processing Step: universal modifications
glb_txt_munge_filenames_pfx <- "<projectId>_mytxt_"

# Text Processing Step: tolower
# Text Processing Step: myreplacePunctuation
# Text Processing Step: removeWords
glb_txt_stop_words <- list()
# Remember to use unstemmed words
if (length(glbFeatsText) > 0) {
    require(tm)
    require(stringr)

    glb_txt_stop_words[["<txt_var>"]] <- sort(myreplacePunctuation(str_to_lower(gsub(" ", "", c(NULL
        # Remove any words from stopwords            
#         , setdiff(myreplacePunctuation(stopwords("english")), c("<keep_wrd1>", <keep_wrd2>"))
                                
        # Remove salutations
        ,"mr","mrs","dr","Rev"                                

        # Remove misc
        #,"th" # Happy [[:digit::]]+th birthday 

        # Remove terms present in Trn only or New only; search for "Partition post-stem"
        #   ,<comma-separated-terms>        

        # cor.y.train == NA
#         ,unlist(strsplit(paste(c(NULL
#           ,"<comma-separated-terms>"
#         ), collapse=",")

        # freq == 1; keep c("<comma-separated-terms-to-keep>")
            # ,<comma-separated-terms>

        # chisq.pval high (e.g. == 1); keep c("<comma-separated-terms-to-keep>")
            # ,<comma-separated-terms>

        # nzv.freqRatio high (e.g. >= glbFeatsNzvFreqMax); keep c("<comma-separated-terms-to-keep>")
            # ,<comma-separated-terms>        
                                            )))))
}
#orderBy(~term, glb_post_stem_words_terms_df_lst[[txtFeat]][grep("^man", glb_post_stem_words_terms_df_lst[[txtFeat]]$term), ])
#glbObsAll[glb_post_stem_words_terms_mtrx_lst[[txtFeat]][, 4866] > 0, c(glb_rsp_var, txtFeat)]

# To identify terms with a specific freq
#paste0(sort(subset(glb_post_stop_words_terms_df_lst[[txtFeat]], freq == 1)$term), collapse = ",")
#paste0(sort(subset(glb_post_stem_words_terms_df_lst[[txtFeat]], freq <= 2)$term), collapse = ",")
#subset(glb_post_stem_words_terms_df_lst[[txtFeat]], term %in% c("zinger"))

# To identify terms with a specific freq & 
#   are not stemmed together later OR is value of color.fctr (e.g. gold)
#paste0(sort(subset(glb_post_stop_words_terms_df_lst[[txtFeat]], (freq == 1) & !(term %in% c("blacked","blemish","blocked","blocks","buying","cables","careful","carefully","changed","changing","chargers","cleanly","cleared","connect","connects","connected","contains","cosmetics","default","defaulting","defective","definitely","describe","described","devices","displays","drop","drops","engravement","excellant","excellently","feels","fix","flawlessly","frame","framing","gentle","gold","guarantee","guarantees","handled","handling","having","install","iphone","iphones","keeped","keeps","known","lights","line","lining","liquid","liquidation","looking","lots","manuals","manufacture","minis","most","mostly","network","networks","noted","opening","operated","performance","performs","person","personalized","photograph","physically","placed","places","powering","pre","previously","products","protection","purchasing","returned","rotate","rotation","running","sales","second","seconds","shipped","shuts","sides","skin","skinned","sticker","storing","thats","theres","touching","unusable","update","updates","upgrade","weeks","wrapped","verified","verify") ))$term), collapse = ",")

#print(subset(glb_post_stem_words_terms_df_lst[[txtFeat]], (freq <= 2)))
#glbObsAll[which(terms_mtrx[, 229] > 0), glbFeatsText]

# To identify terms with cor.y == NA
#orderBy(~-freq+term, subset(glb_post_stop_words_terms_df_lst[[txtFeat]], is.na(cor.y)))
#paste(sort(subset(glb_post_stop_words_terms_df_lst[[txtFeat]], is.na(cor.y))[, "term"]), collapse=",")
#orderBy(~-freq+term, subset(glb_post_stem_words_terms_df_lst[[txtFeat]], is.na(cor.y)))

# To identify terms with low cor.y.abs
#head(orderBy(~cor.y.abs+freq+term, subset(glb_post_stem_words_terms_df_lst[[txtFeat]], !is.na(cor.y))), 5)

# To identify terms with high chisq.pval
#subset(glb_post_stem_words_terms_df_lst[[txtFeat]], chisq.pval > 0.99)
#paste0(sort(subset(glb_post_stem_words_terms_df_lst[[txtFeat]], (chisq.pval > 0.99) & (freq <= 10))$term), collapse=",")
#paste0(sort(subset(glb_post_stem_words_terms_df_lst[[txtFeat]], (chisq.pval > 0.9))$term), collapse=",")
#head(orderBy(~-chisq.pval+freq+term, glb_post_stem_words_terms_df_lst[[txtFeat]]), 5)
#glbObsAll[glb_post_stem_words_terms_mtrx_lst[[txtFeat]][, 68] > 0, glbFeatsText]
#orderBy(~term, glb_post_stem_words_terms_df_lst[[txtFeat]][grep("^m", glb_post_stem_words_terms_df_lst[[txtFeat]]$term), ])

# To identify terms with high nzv.freqRatio
#summary(glb_post_stem_words_terms_df_lst[[txtFeat]]$nzv.freqRatio)
#paste0(sort(setdiff(subset(glb_post_stem_words_terms_df_lst[[txtFeat]], (nzv.freqRatio >= glbFeatsNzvFreqMax) & (freq < 10) & (chisq.pval >= 0.05))$term, c( "128gb","3g","4g","gold","ipad1","ipad3","ipad4","ipadair2","ipadmini2","manufactur","spacegray","sprint","tmobil","verizon","wifion"))), collapse=",")

# To identify obs with a txt term
#tail(orderBy(~-freq+term, glb_post_stop_words_terms_df_lst[[txtFeat]]), 20)
#mydspObs(list(descr.my.contains="non"), cols=c("color", "carrier", "cellular", "storage"))
#grep("ever", dimnames(terms_stop_mtrx)$Terms)
#which(terms_stop_mtrx[, grep("ipad", dimnames(terms_stop_mtrx)$Terms)] > 0)
#glbObsAll[which(terms_stop_mtrx[, grep("16", dimnames(terms_stop_mtrx)$Terms)[1]] > 0), c(glbFeatsCategory, "storage", txtFeat)]

# Text Processing Step: screen for names # Move to glbFeatsText specs section in order of text processing steps
# glbFeatsText[["<txtFeat>"]]$names <- myreplacePunctuation(str_to_lower(gsub(" ", "", c(NULL
#         # Person names for names screening
#         ,<comma-separated-list>
#         
#         # Company names
#         ,<comma-separated-list>
#                     
#         # Product names
#         ,<comma-separated-list>
#     ))))

# glbFeatsText[["<txtFeat>"]]$rareWords <- myreplacePunctuation(str_to_lower(gsub(" ", "", c(NULL
#         # Words not in SCOWL db
#         ,<comma-separated-list>
#     ))))

# To identify char vectors post glbFeatsTextMap
#grep("six(.*)hour", glb_txt_chr_lst[[txtFeat]], ignore.case = TRUE, value = TRUE)
#grep("[S|s]ix(.*)[H|h]our", glb_txt_chr_lst[[txtFeat]], value = TRUE)

# To identify whether terms shd be synonyms
#orderBy(~term, glb_post_stop_words_terms_df_lst[[txtFeat]][grep("^moder", glb_post_stop_words_terms_df_lst[[txtFeat]]$term), ])
# term_row_df <- glb_post_stop_words_terms_df_lst[[txtFeat]][grep("^came$", glb_post_stop_words_terms_df_lst[[txtFeat]]$term), ]
# 
# cor(glb_post_stop_words_terms_mtrx_lst[[txtFeat]][glbObsAll$.lcn == "Fit", term_row_df$pos], glbObsTrn[, glb_rsp_var], use="pairwise.complete.obs")

# To identify which stopped words are "close" to a txt term
#sort(glbFeatsCluster)

# Text Processing Step: stemDocument
# To identify stemmed txt terms
#glb_post_stop_words_terms_df_lst[[txtFeat]][grep("^la$", glb_post_stop_words_terms_df_lst[[txtFeat]]$term), ]
#orderBy(~term, glb_post_stem_words_terms_df_lst[[txtFeat]][grep("^con", glb_post_stem_words_terms_df_lst[[txtFeat]]$term), ])
#glbObsAll[which(terms_stem_mtrx[, grep("use", dimnames(terms_stem_mtrx)$Terms)[[1]]] > 0), c(glbFeatsId, "productline", txtFeat)]
#glbObsAll[which(TfIdf_stem_mtrx[, 191] > 0), c(glbFeatsId, glbFeatsCategory, txtFeat)]
#glbObsAll[which(glb_post_stop_words_terms_mtrx_lst[[txtFeat]][, 6165] > 0), c(glbFeatsId, glbFeatsCategory, txtFeat)]
#which(glbObsAll$UniqueID %in% c(11915, 11926, 12198))

# Text Processing Step: mycombineSynonyms
#   To identify which terms are associated with not -> combine "could not" & "couldn't"
#findAssocs(glb_full_DTM_lst[[txtFeat]], "not", 0.05)
#   To identify which synonyms should be combined
#orderBy(~term, glb_post_stem_words_terms_df_lst[[txtFeat]][grep("^c", glb_post_stem_words_terms_df_lst[[txtFeat]]$term), ])
chk_comb_cor <- function(syn_lst) {
#     cor(terms_stem_mtrx[glbObsAll$.src == "Train", grep("^(damag|dent|ding)$", dimnames(terms_stem_mtrx)[[2]])], glbObsTrn[, glb_rsp_var], use="pairwise.complete.obs")
    print(subset(glb_post_stem_words_terms_df_lst[[txtFeat]], term %in% syn_lst$syns))
    print(subset(get_corpus_terms(tm_map(glbFeatsTextCorpus[[txtFeat]], mycombineSynonyms, list(syn_lst), lazy=FALSE)), term == syn_lst$word))
#     cor(terms_stop_mtrx[glbObsAll$.src == "Train", grep("^(damage|dent|ding)$", dimnames(terms_stop_mtrx)[[2]])], glbObsTrn[, glb_rsp_var], use="pairwise.complete.obs")
#     cor(rowSums(terms_stop_mtrx[glbObsAll$.src == "Train", grep("^(damage|dent|ding)$", dimnames(terms_stop_mtrx)[[2]])]), glbObsTrn[, glb_rsp_var], use="pairwise.complete.obs")
}
#chk_comb_cor(syn_lst=list(word="cabl",  syns=c("cabl", "cord")))
#chk_comb_cor(syn_lst=list(word="damag",  syns=c("damag", "dent", "ding")))
#chk_comb_cor(syn_lst=list(word="dent",  syns=c("dent", "ding")))
#chk_comb_cor(syn_lst=list(word="use",  syns=c("use", "usag")))

glbFeatsTextSynonyms <- list()
# list parsed to collect glbFeatsText[[<txtFeat>]]$vldTerms
# glbFeatsTextSynonyms[["Hdln.my"]] <- list(NULL
#     # people in places
#     , list(word = "australia", syns = c("australia", "australian"))
#     , list(word = "italy", syns = c("italy", "Italian"))
#     , list(word = "newyork", syns = c("newyork", "newyorker"))    
#     , list(word = "Pakistan", syns = c("Pakistan", "Pakistani"))    
#     , list(word = "peru", syns = c("peru", "peruvian"))
#     , list(word = "qatar", syns = c("qatar", "qatari"))
#     , list(word = "scotland", syns = c("scotland", "scotish"))
#     , list(word = "Shanghai", syns = c("Shanghai", "Shanzhai"))    
#     , list(word = "venezuela", syns = c("venezuela", "venezuelan"))    
# 
#     # companies - needs to be data dependent 
#     #   - e.g. ensure BNP in this experiment/feat always refers to BNPParibas
#         
#     # general synonyms
#     , list(word = "Create", syns = c("Create","Creator")) 
#     , list(word = "cute", syns = c("cute","cutest"))     
#     , list(word = "Disappear", syns = c("Disappear","Fadeout"))     
#     , list(word = "teach", syns = c("teach", "taught"))     
#     , list(word = "theater",  syns = c("theater", "theatre", "theatres")) 
#     , list(word = "understand",  syns = c("understand", "understood"))    
#     , list(word = "weak",  syns = c("weak", "weaken", "weaker", "weakest"))
#     , list(word = "wealth",  syns = c("wealth", "wealthi"))    
#     
#     # custom synonyms (phrases)
#     
#     # custom synonyms (names)
#                                       )
#glbFeatsTextSynonyms[["<txtFeat>"]] <- list(NULL
#     , list(word="<stem1>",  syns=c("<stem1>", "<stem1_2>"))
#                                       )

for (txtFeat in names(glbFeatsTextSynonyms))
    for (entryIx in 1:length(glbFeatsTextSynonyms[[txtFeat]])) {
        glbFeatsTextSynonyms[[txtFeat]][[entryIx]]$word <-
            str_to_lower(glbFeatsTextSynonyms[[txtFeat]][[entryIx]]$word)
        glbFeatsTextSynonyms[[txtFeat]][[entryIx]]$syns <-
            str_to_lower(glbFeatsTextSynonyms[[txtFeat]][[entryIx]]$syns)        
    }        

glbFeatsTextSeed <- 181
# tm options include: check tm::weightSMART 
glb_txt_terms_control <- list( # Gather model performance & run-time stats
                    # weighting = function(x) weightSMART(x, spec = "nnn")
                    # weighting = function(x) weightSMART(x, spec = "lnn")
                    # weighting = function(x) weightSMART(x, spec = "ann")
                    # weighting = function(x) weightSMART(x, spec = "bnn")
                    # weighting = function(x) weightSMART(x, spec = "Lnn")
                    # 
                    weighting = function(x) weightSMART(x, spec = "ltn") # default
                    # weighting = function(x) weightSMART(x, spec = "lpn")                    
                    # 
                    # weighting = function(x) weightSMART(x, spec = "ltc")                    
                    # 
                    # weighting = weightBin 
                    # weighting = weightTf 
                    # weighting = weightTfIdf # : default
                # termFreq selection criteria across obs: tm default: list(global=c(1, Inf))
                    , bounds = list(global = c(1, Inf)) 
                # wordLengths selection criteria: tm default: c(3, Inf)
                    , wordLengths = c(1, Inf) 
                              ) 

glb_txt_cor_var <- glb_rsp_var # : default # or c(<feat>)

# select one from c("union.top.val.cor", "top.cor", "top.val", default: "top.chisq", "sparse")
glbFeatsTextFilter <- "top.chisq" 
glbFeatsTextTermsMax <- rep(10, length(glbFeatsText)) # :default
names(glbFeatsTextTermsMax) <- names(glbFeatsText)

# Text Processing Step: extractAssoc
glbFeatsTextAssocCor <- rep(1, length(glbFeatsText)) # :default 
names(glbFeatsTextAssocCor) <- names(glbFeatsText)

# Remember to use stemmed terms
glb_important_terms <- list()

# Text Processing Step: extractPatterns (ngrams)
glbFeatsTextPatterns <- list()
#glbFeatsTextPatterns[[<txtFeat>>]] <- list()
#glbFeatsTextPatterns[[<txtFeat>>]] <- c(metropolitan.diary.colon = "Metropolitan Diary:")

# Have to set it even if it is not used
# Properties:
#   numrows(glb_feats_df) << numrows(glbObsFit
#   Select terms that appear in at least 0.2 * O(FP/FN(glbObsOOB)) ???
#       numrows(glbObsOOB) = 1.1 * numrows(glbObsNew) ???
glb_sprs_thresholds <- NULL # or c(<txtFeat1> = 0.988, <txtFeat2> = 0.970, <txtFeat3> = 0.970)

glbFctrMaxUniqVals <- 20 # default: 20
glb_impute_na_data <- FALSE # or TRUE
glb_mice_complete.seed <- 144 # or any integer

glbFeatsCluster <- paste(grep("^Q.", glbFeatsExclude, value = TRUE), "fctr", sep = ".") # NULL : glbFeatsCluster <- c("YOB.Age.fctr", "Gender.fctr", "Income.fctr", 
                     # # "Hhold.fctr",
                     # "Edn.fctr",
                     # paste(grep("^Q.", glbFeatsExclude, value = TRUE), "fctr", sep = ".")) # NULL : default or c("<feat1>", "<feat2>")
# glbFeatsCluster <- grep(paste0("[", 
#                         toupper(paste0(substr(glbFeatsText, 1, 1), collapse = "")),
#                                       "]\\.[PT]\\."), 
#                                names(glbObsAll), value = TRUE)

glb_cluster.seed <- 189 # or any integer
glbClusterEntropyVar <- NULL # c(glb_rsp_var, as.factor(cut(glb_rsp_var, 3)), default: NULL)
glbFeatsClusterVarsExclude <- FALSE # default FALSE

glb_interaction_only_feats <- NULL # : default or c(<parent_feat> = "<child_feat>")

glbFeatsNzvFreqMax <- 19 # 19 : caret default
glbFeatsNzvUniqMin <- 10 # 10 : caret default

glbRFESizes <- list()
#glbRFESizes[["mdlFamily"]] <- c(4, 8, 16, 32, 64, 67, 68, 69) # Accuracy@69/70 = 0.8258
glbRFESizes[["RFE.X"]] <- c(96, 112, 120, 124, 128, 129, 130, 131, 132, 133, 135, 138, 142, 157, 187, 247) # accuracy(131) = 0.6285
glbRFESizes[["Final"]] <- c(8, 16, 32, 40, 44, 46, 48, 49, 50, 51, 52, 56, 64, 96, 128, 247) # accuracy(49) = 0.6164

glbRFEResults <- NULL

glbObsFitOutliers <- list()
# If outliers.n >= 10; consider concatenation of interaction vars
# glbObsFitOutliers[["<mdlFamily>"]] <- c(NULL
#     is.na(.rstudent)
#     max(.rstudent)
#     is.na(.dffits)
#     .hatvalues >= 0.99        
#     -38,167,642 < minmax(.rstudent) < 49,649,823    
#     , <comma-separated-<glbFeatsId>>
#                                     )
glbObsTrnOutliers <- list()
glbObsTrnOutliers[["Final"]] <- union(glbObsFitOutliers[["All.X"]],
                                c(NULL
                                ))

# Modify mdlId to (build & extract) "<FamilyId>#<Fit|Trn>#<caretMethod>#<preProc1.preProc2>#<samplingMethod>"
glb_models_lst <- list(); glb_models_df <- data.frame()

# Add xgboost algorithm

# Regression
if (glb_is_regression) {
    glbMdlMethods <- c(NULL
        # deterministic
            #, "lm", # same as glm
            , "glm", "bayesglm", "glmnet"
            , "rpart"
        # non-deterministic
            , "gbm", "rf" 
        # Unknown
            , "nnet" , "avNNet" # runs 25 models per cv sample for tunelength=5
            , "svmLinear", "svmLinear2"
            , "svmPoly" # runs 75 models per cv sample for tunelength=5
            , "svmRadial" 
            , "earth"
            , "bagEarth" # Takes a long time
            ,"xgbLinear","xgbTree"
        )
} else
# Classification - Add ada (auto feature selection)
    if (glb_is_binomial)
        glbMdlMethods <- c(NULL
        # deterministic                     
            , "bagEarth" # Takes a long time        
            , "glm", "bayesglm", "glmnet"
            , "nnet"
            , "rpart"
        # non-deterministic        
            , "gbm"
            , "avNNet" # runs 25 models per cv sample for tunelength=5      
            , "rf"
        # Unknown
            , "lda", "lda2"
                # svm models crash when predict is called -> internal to kernlab it should call predict without .outcome
            , "svmLinear", "svmLinear2"
            , "svmPoly" # runs 75 models per cv sample for tunelength=5
            , "svmRadial" 
            , "earth"
            ,"xgbLinear","xgbTree"
        ) else
        glbMdlMethods <- c(NULL
        # deterministic
            ,"glmnet"
        # non-deterministic 
            ,"rf"       
        # Unknown
            ,"gbm","rpart","xgbLinear","xgbTree"
        )

glbMdlFamilies <- list(); glb_mdl_feats_lst <- list()
# family: Choose from c("RFE.X", "Csm.X", "All.X", "Best.Interact") %*% c(NUll, ".NOr", ".Inc")
#   RFE = "Recursive Feature Elimination"
#   Csm = CuStoM
#   NOr = No OutlieRs
#   Inc = INteraCt
#   methods: Choose from c(NULL, <method>, glbMdlMethods) 
#glbMdlFamilies[["RFE.X"]] <- c("glmnet", "glm") # non-NULL vector is mandatory
if (glb_is_classification && !glb_is_binomial) {
    # glm does not work for multinomial
    glbMdlFamilies[["All.X"]] <- c("glmnet") 
} else {
    glbMdlFamilies[["All.X"]] <- c("glmnet", "glm")
    # glbMdlFamilies[["RFE.X"]] <- c("glmnet", "glm")
    glbMdlFamilies[["RFE.X"]] <- setdiff(glbMdlMethods, c(NULL
        , "bayesglm" # error: Error in trControl$classProbs && any(classLevels != make.names(classLevels)) : invalid 'x' type in 'x && y'
        , "lda","lda2" # error: Error in lda.default(x, grouping, ...) : variable 236 appears to be constant within groups
        , "svmLinear" # Error in .local(object, ...) : test vector does not match model ! In addition: Warning messages:
        , "svmLinear2" # SVM has not been trained using `probability = TRUE`, probabilities not available for predictions
        , "svmPoly" # runs 75 models per cv sample for tunelength=5 # took > 2 hrs # Error in .local(object, ...) : test vector does not match model !     
        , "svmRadial" # didn't bother
        ,"xgbLinear","xgbTree" # Need clang-omp compiler; Upgrade to Revolution R 3.2.3 (3.2.2 current); https://github.com/dmlc/xgboost/issues/276 thread
                                        ))
}
glbMdlFamilies[["All.X.Inc"]] <- glbMdlFamilies[["All.X"]] # value not used
glbMdlFamilies[["RFE.X.Inc"]] <- glbMdlFamilies[["RFE.X"]] # value not used

# Check if interaction features make RFE better
# glbMdlFamilies[["CSM.X"]] <- setdiff(glbMdlMethods, c("lda", "lda2")) # crashing due to category:.clusterid ??? #c("glmnet", "glm") # non-NULL list is mandatory
# glb_mdl_feats_lst[["CSM.X"]] <- c(NULL
#     , <comma-separated-features-vector>
#                                   )
# dAFeats.CSM.X %<d-% c(NULL
#     # Interaction feats up to varImp(RFE.X.glmnet) >= 50
#     , <comma-separated-features-vector>
#     , setdiff(myextract_actual_feats(predictors(glbRFEResults)), c(NULL
#                , <comma-separated-features-vector>
#                                                                       ))    
#                                   )
# glb_mdl_feats_lst[["CSM.X"]] <- "%<d-% dAFeats.CSM.X"

glbMdlFamilies[["Final"]] <- c(NULL) # NULL vector acceptable # c("glmnet", "glm")

glbMdlAllowParallel <- list()
#glbMdlAllowParallel[["Final##rcv#glmnet"]] <- FALSE
glbMdlAllowParallel[["All.X##rcv#glm"]] <- FALSE
glbMdlAllowParallel[["All.X#zv.pca#rcv#glmnet"]] <- FALSE
glbMdlAllowParallel[["All.X#ica#rcv#glmnet"]] <- FALSE

glbMdlAllowParallel[["RFE.X#zv.pca#rcv#glmnet"]] <- FALSE
glbMdlAllowParallel[["RFE.X#ica#rcv#glmnet"]] <- FALSE
glbMdlAllowParallel[["RFE.X#nzv.pca.spatialSign#rcv#glmnet"]] <- FALSE
glbMdlAllowParallel[["RFE.X##rcv#glm"]] <- FALSE
glbMdlAllowParallel[["RFE.X##rcv#bayesglm"]] <- FALSE
glbMdlAllowParallel[["RFE.X##rcv#rpart"]] <- FALSE
glbMdlAllowParallel[["RFE.X##rcv#lda"]] <- FALSE
glbMdlAllowParallel[["RFE.X##rcv#lda2"]] <- FALSE
glbMdlAllowParallel[["RFE.X##rcv#svmLinear"]] <- FALSE
glbMdlAllowParallel[["RFE.X##rcv#svmPoly"]] <- FALSE
glbMdlAllowParallel[["RFE.X##rcv#earth"]] <- FALSE

glbMdlAllowParallel[["Final.RFE.X#zv.pca#rcv#glmnet"]] <- FALSE
glbMdlAllowParallel[["Final.All.X#ica#rcv#glmnet"]] <- FALSE

glbMdlAllowParallel[["Ensemble.auto##boot#glmnet"]] <- FALSE
glbMdlAllowParallel[["Ensemble.auto##boot632#glmnet"]] <- FALSE
glbMdlAllowParallel[["Ensemble.auto##rcv#glm"]] <- FALSE
glbMdlAllowParallel[["Ensemble.auto.2##boot#glmnet"]] <- FALSE
glbMdlAllowParallel[["Ensemble.auto.2##boot632#glmnet"]] <- FALSE

# Check if tuning parameters make fit better; make it mdlFamily customizable ?
glbMdlTuneParams <- data.frame()
# When glmnet crashes at model$grid with error: ???
# glmnetTuneParams <- rbind(data.frame()
#                         ,data.frame(parameter = "alpha",  vals = "0.100 0.325 0.550 0.775 1.000")
#                         ,data.frame(parameter = "lambda", vals = "9.342e-02")    
#                         )
# glbMdlTuneParams <- myrbind_df(glbMdlTuneParams,
#                                cbind(data.frame(mdlId = "<mdlId>"),
#                                      glmnetTuneParams))

    #avNNet    
    #   size=[1] 3 5 7 9; decay=[0] 1e-04 0.001  0.01   0.1; bag=[FALSE]; RMSE=1.3300906 

    #bagEarth
    #   degree=1 [2] 3; nprune=64 128 256 512 [1024]; RMSE=0.6486663 (up)
bagEarthTuneParams <- rbind(data.frame()
                        ,data.frame(parameter = "degree", vals = "1")
                        ,data.frame(parameter = "nprune", vals = "256")
                        )
glbMdlTuneParams <- myrbind_df(glbMdlTuneParams,
                               cbind(data.frame(mdlId = "Final.RFE.X.Inc##rcv#bagEarth"),
                                     bagEarthTuneParams))

# glbMdlTuneParams <- myrbind_df(glbMdlTuneParams, rbind(data.frame()
#     ,data.frame(method = "bagEarth", parameter = "nprune", vals = "256")
#     ,data.frame(method = "bagEarth", parameter = "degree", vals = "2")    
# ))

    #earth 
    #   degree=[1]; nprune=2  [9] 17 25 33; RMSE=0.1334478
    
    #gbm 
    #   shrinkage=0.05 [0.10] 0.15 0.20 0.25; n.trees=100 150 200 [250] 300; interaction.depth=[1] 2 3 4 5; n.minobsinnode=[10]; RMSE=0.2008313     
# glbMdlTuneParams <- myrbind_df(glbMdlTuneParams, rbind(data.frame()
#     ,data.frame(method = "gbm", parameter = "shrinkage", min = 0.05, max = 0.25, by = 0.05)
#     ,data.frame(method = "gbm", parameter = "n.trees", min = 100, max = 300, by = 50)
#     ,data.frame(method = "gbm", parameter = "interaction.depth", min = 1, max = 5, by = 1)
#     ,data.frame(method = "gbm", parameter = "n.minobsinnode", min = 10, max = 10, by = 10)
#     #seq(from=0.05,  to=0.25, by=0.05)
# ))

    #glmnet
    #   alpha=0.100 [0.325] 0.550 0.775 1.000; lambda=0.0005232693 0.0024288010 0.0112734954 [0.0523269304] 0.2428800957; RMSE=0.6164891
# glbMdlTuneParams <- myrbind_df(glbMdlTuneParams, rbind(data.frame()
#     ,data.frame(method = "glmnet", parameter = "alpha", vals = "0.550 0.775 0.8875 0.94375 1.000")
#     ,data.frame(method = "glmnet", parameter = "lambda", vals = "9.858855e-05 0.0001971771 0.0009152152 0.0042480525 0.0197177130")    
# ))

    #nnet    
    #   size=3 5 [7] 9 11; decay=0.0001 0.001 0.01 [0.1] 0.2; RMSE=0.9287422
# glbMdlTuneParams <- myrbind_df(glbMdlTuneParams, rbind(data.frame()
#     ,data.frame(method = "nnet", parameter = "size", vals = "3 5 7 9 11")
#     ,data.frame(method = "nnet", parameter = "decay", vals = "0.0001 0.0010 0.0100 0.1000 0.2000")    
# ))

    #rf # Don't bother; results are not deterministic
    #       mtry=2  35  68 [101] 134; RMSE=0.1339974
# glbMdlTuneParams <- myrbind_df(glbMdlTuneParams, rbind(data.frame()
#     ,data.frame(method = "rf", parameter = "mtry", vals = "2 5 9 13 17")
# ))

    #rpart 
    #   cp=0.020 [0.025] 0.030 0.035 0.040; RMSE=0.1770237
# glbMdlTuneParams <- myrbind_df(glbMdlTuneParams, rbind(data.frame()    
#     ,data.frame(method = "rpart", parameter = "cp", vals = "0.004347826 0.008695652 0.017391304 0.021739130 0.034782609")
# ))
    
    #svmLinear
    #   C=0.01 0.05 [0.10] 0.50 1.00 2.00 3.00 4.00; RMSE=0.1271318; 0.1296718
# glbMdlTuneParams <- myrbind_df(glbMdlTuneParams, rbind(data.frame()
#     ,data.frame(method = "svmLinear", parameter = "C", vals = "0.01 0.05 0.1 0.5 1")
# ))

    #svmLinear2    
    #   cost=0.0625 0.1250 [0.25] 0.50 1.00; RMSE=0.1276354 
# glbMdlTuneParams <- myrbind_df(glbMdlTuneParams, rbind(data.frame()
#     ,data.frame(method = "svmLinear2", parameter = "cost", vals = "0.0625 0.125 0.25 0.5 1")
# ))

    #svmPoly    
    #   degree=[1] 2 3 4 5; scale=0.01 0.05 [0.1] 0.5 1; C=0.50 1.00 [2.00] 3.00 4.00; RMSE=0.1276130
# glbMdlTuneParams <- myrbind_df(glbMdlTuneParams, rbind(data.frame()
#     ,data.frame(method="svmPoly", parameter="degree", min=1, max=5, by=1) #seq(1, 5, 1)
#     ,data.frame(method="svmPoly", parameter="scale", vals="0.01, 0.05, 0.1, 0.5, 1")
#     ,data.frame(method="svmPoly", parameter="C", vals="0.50, 1.00, 2.00, 3.00, 4.00")    
# ))

    #svmRadial
    #   sigma=[0.08674323]; C=0.25 0.50 1.00 [2.00] 4.00; RMSE=0.1614957
    
#glb2Sav(); all.equal(sav_models_df, glb_models_df)

pkgPreprocMethods <-     
# caret version: 6.0.068 # packageVersion("caret")
# operations are applied in this order: zero-variance filter, near-zero variance filter, Box-Cox/Yeo-Johnson/exponential transformation, centering, scaling, range, imputation, PCA, ICA then spatial sign
# *Impute methods needed only if NAs are fed to myfit_mdl
#   Also, ordered.factor in caret creates features as Edn.fctr^4 which is treated as an exponent by bagImpute
    c(NULL
      ,"zv", "nzv"
      ,"BoxCox", "YeoJohnson", "expoTrans"
      ,"center", "scale", "center.scale", "range"
      ,"knnImpute", "bagImpute", "medianImpute"
      ,"zv.pca", "ica", "spatialSign"
      ,"conditionalX") 

glbMdlPreprocMethods <- list( # NULL # : default
    "All.X" = list("glmnet" = union(setdiff(pkgPreprocMethods, 
                                              c("knnImpute", "bagImpute", "medianImpute")),
                                    # NULL))
                                    c("nzv.spatialSign")))    
)
glbMdlPreprocMethods[["RFE.X"]] <- list("glmnet" = union(unlist(glbMdlPreprocMethods[["All.X"]]),
                                                    "nzv.pca.spatialSign"))

# Baseline prediction model feature(s)
glb_Baseline_mdl_var <- NULL # or c("<feat>")

glbMdlMetric_terms <- NULL # or matrix(c(
#                               0,1,2,3,4,
#                               2,0,1,2,3,
#                               4,2,0,1,2,
#                               6,4,2,0,1,
#                               8,6,4,2,0
#                           ), byrow=TRUE, nrow=5)
glbMdlMetricSummary <- NULL # or "<metric_name>"
glbMdlMetricMaximize <- NULL # or FALSE (TRUE is not the default for both classification & regression) 
glbMdlMetricSummaryFn <- NULL # or function(data, lev=NULL, model=NULL) {
#     confusion_mtrx <- t(as.matrix(confusionMatrix(data$pred, data$obs)))
#     #print(confusion_mtrx)
#     #print(confusion_mtrx * glbMdlMetric_terms)
#     metric <- sum(confusion_mtrx * glbMdlMetric_terms) / nrow(data)
#     names(metric) <- glbMdlMetricSummary
#     return(metric)
# }

glbMdlCheckRcv <- FALSE # Turn it on when needed; otherwise takes long time
glb_rcv_n_folds <- 3 # or NULL
glb_rcv_n_repeats <- 3 # or NULL

glb_clf_proba_threshold <- NULL # 0.5

# Model selection criteria
if (glb_is_regression)
    glbMdlMetricsEval <- c("min.RMSE.OOB", "max.R.sq.OOB", "min.elapsedtime.everything",
                           "max.Adj.R.sq.fit", "min.RMSE.fit")
    #glbMdlMetricsEval <- c("min.RMSE.fit", "max.R.sq.fit", "max.Adj.R.sq.fit")    
if (glb_is_classification) {
    if (glb_is_binomial)
        glbMdlMetricsEval <- 
            c("max.Accuracy.OOB", "max.AUCROCR.OOB", "max.AUCpROC.OOB",
              "min.elapsedtime.everything", 
              # "min.aic.fit", 
              "max.Accuracy.fit") else        
        glbMdlMetricsEval <- c("max.Accuracy.OOB", "max.Kappa.OOB", "min.elapsedtime.everything")
}

# select from NULL [no ensemble models], "auto" [all models better than MFO or Baseline], c(mdl_ids in glb_models_lst) [Typically top-rated models in auto]
glbMdlEnsemble <- "auto"
#     "%<d-% setdiff(mygetEnsembleAutoMdlIds(), 'CSM.X.rf')" 
#     c(<comma-separated-mdlIds>
#      )

# Only for classifications; for regressions remove "(.*)\\.prob" form the regex
# tmp_fitobs_df <- glbObsFit[, grep(paste0("^", gsub(".", "\\.", mygetPredictIds$value, fixed = TRUE), "CSM\\.X\\.(.*)\\.prob"), names(glbObsFit), value = TRUE)]; cor_mtrx <- cor(tmp_fitobs_df); cor_vctr <- sort(cor_mtrx[row.names(orderBy(~-Overall, varImp(glb_models_lst[["Ensemble.repeatedcv.glmnet"]])$imp))[1], ]); summary(cor_vctr); cor_vctr
#ntv.glm <- glm(reformulate(indepVar, glb_rsp_var), family = "binomial", data = glbObsFit)
#step.glm <- step(ntv.glm)

glbMdlSelId <- NULL #select from c(NULL, "All.X##rcv#glmnet", "RFE.X##rcv#glmnet", <mdlId>)
glbMdlFinId <- NULL #select from c(NULL, glbMdlSelId)

glb_dsp_cols <- c(".pos", glbFeatsId, glbFeatsCategory, glb_rsp_var
#               List critical cols excl. above
                  )

# Output specs
# lclgetfltout_df <- function(obsOutFinDf) {
#     require(tidyr)
#     obsOutFinDf <- obsOutFinDf %>%
#         tidyr::separate("ImageId.x.y", c(".src", ".pos", "x", "y"), 
#                         sep = "#", remove = TRUE, extra = "merge")
#     # mnm prefix stands for max_n_mean
#     mnmout_df <- obsOutFinDf %>%
#         dplyr::group_by(.pos) %>%
#         #dplyr::top_n(1, Probability1) %>% # Score = 3.9426         
#         #dplyr::top_n(2, Probability1) %>% # Score = ???; weighted = 3.94254;         
#         #dplyr::top_n(3, Probability1) %>% # Score = 3.9418; weighted = 3.94169; 
#         dplyr::top_n(4, Probability1) %>% # Score = ???; weighted = 3.94149;        
#         #dplyr::top_n(5, Probability1) %>% # Score = 3.9421; weighted = 3.94178
#     
#         # dplyr::summarize(xMeanN = mean(as.numeric(x)), yMeanN = mean(as.numeric(y)))
#         # dplyr::summarize(xMeanN = weighted.mean(as.numeric(x), Probability1), yMeanN = mean(as.numeric(y)))
#         # dplyr::summarize(xMeanN = weighted.mean(as.numeric(x), c(Probability1, 0.2357323, 0.2336925)), yMeanN = mean(as.numeric(y)))    
#         # dplyr::summarize(xMeanN = weighted.mean(as.numeric(x), c(Probability1)), yMeanN = mean(as.numeric(y)))
#         dplyr::summarize(xMeanN = weighted.mean(as.numeric(x), c(Probability1)), 
#                          yMeanN = weighted.mean(as.numeric(y), c(Probability1)))  
#     
#     maxout_df <- obsOutFinDf %>%
#         dplyr::group_by(.pos) %>%
#         dplyr::summarize(maxProb1 = max(Probability1))
#     fltout_df <- merge(maxout_df, obsOutFinDf, 
#                        by.x = c(".pos", "maxProb1"), by.y = c(".pos", "Probability1"),
#                        all.x = TRUE)
#     fmnout_df <- merge(fltout_df, mnmout_df, 
#                        by.x = c(".pos"), by.y = c(".pos"),
#                        all.x = TRUE)
#     return(fmnout_df)
# }
glbObsOut <- list(NULL
        # glbFeatsId will be the first output column, by default
        ,vars = list()
#         ,mapFn = function(obsOutFinDf) {
#                   }
                  )
#obsOutFinDf <- savobsOutFinDf
# glbObsOut$mapFn <- function(obsOutFinDf) {
#     txfout_df <- dplyr::select(obsOutFinDf, -.pos.y) %>%
#         dplyr::mutate(
#             lunch     = levels(glbObsTrn[, "lunch"    ])[
#                        round(mean(as.numeric(glbObsTrn[, "lunch"    ])), 0)],
#             dinner    = levels(glbObsTrn[, "dinner"   ])[
#                        round(mean(as.numeric(glbObsTrn[, "dinner"   ])), 0)],
#             reserve   = levels(glbObsTrn[, "reserve"  ])[
#                        round(mean(as.numeric(glbObsTrn[, "reserve"  ])), 0)],
#             outdoor   = levels(glbObsTrn[, "outdoor"  ])[
#                        round(mean(as.numeric(glbObsTrn[, "outdoor"  ])), 0)],
#             expensive = levels(glbObsTrn[, "expensive"])[
#                        round(mean(as.numeric(glbObsTrn[, "expensive"])), 0)],
#             liquor    = levels(glbObsTrn[, "liquor"   ])[
#                        round(mean(as.numeric(glbObsTrn[, "liquor"   ])), 0)],
#             table     = levels(glbObsTrn[, "table"    ])[
#                        round(mean(as.numeric(glbObsTrn[, "table"    ])), 0)],
#             classy    = levels(glbObsTrn[, "classy"   ])[
#                        round(mean(as.numeric(glbObsTrn[, "classy"   ])), 0)],
#             kids      = levels(glbObsTrn[, "kids"     ])[
#                        round(mean(as.numeric(glbObsTrn[, "kids"     ])), 0)]
#                       )
#     
#     print("ObsNew output class tables:")
#     print(sapply(c("lunch","dinner","reserve","outdoor",
#                    "expensive","liquor","table",
#                    "classy","kids"), 
#                  function(feat) table(txfout_df[, feat], useNA = "ifany")))
#     
#     txfout_df <- txfout_df %>%
#         dplyr::mutate(labels = "") %>%
#         dplyr::mutate(labels = 
#     ifelse(lunch     != "-1", paste(labels, lunch    ), labels)) %>%
#         dplyr::mutate(labels = 
#     ifelse(dinner    != "-1", paste(labels, dinner   ), labels)) %>%
#         dplyr::mutate(labels = 
#     ifelse(reserve   != "-1", paste(labels, reserve  ), labels)) %>%
#         dplyr::mutate(labels = 
#     ifelse(outdoor   != "-1", paste(labels, outdoor  ), labels)) %>%
#         dplyr::mutate(labels =         
#     ifelse(expensive != "-1", paste(labels, expensive), labels)) %>%
#         dplyr::mutate(labels =         
#     ifelse(liquor    != "-1", paste(labels, liquor   ), labels)) %>%
#         dplyr::mutate(labels =         
#     ifelse(table     != "-1", paste(labels, table    ), labels)) %>%
#         dplyr::mutate(labels =         
#     ifelse(classy    != "-1", paste(labels, classy   ), labels)) %>%
#         dplyr::mutate(labels =         
#     ifelse(kids      != "-1", paste(labels, kids     ), labels)) %>%
#         dplyr::select(business_id, labels)
#     return(txfout_df)
# }
#if (!is.null(glbObsOut$mapFn)) obsOutFinDf <- glbObsOut$mapFn(obsOutFinDf); print(head(obsOutFinDf))

glb_out_obs <- NULL # select from c(NULL : default to "new", "all", "new", "trn")

if (glb_is_classification && glb_is_binomial) {
    # glbObsOut$vars[["Probability1"]] <- 
    #     "%<d-% glbObsNew[, mygetPredictIds(glb_rsp_var, glbMdlFinId)$prob]" 
    # glbObsOut$vars[[glb_rsp_var_raw]] <-
    #     "%<d-% glb_map_rsp_var_to_raw(glbObsNew[,
    #                                         mygetPredictIds(glb_rsp_var, glbMdlFinId)$value])"
    glbObsOut$vars[["Predictions"]] <-
        "%<d-% glb_map_rsp_var_to_raw(glbObsNew[,
                                            mygetPredictIds(glb_rsp_var, glbMdlFinId)$value])"
} else {
#     glbObsOut$vars[[glbFeatsId]] <- 
#         "%<d-% as.integer(gsub('Test#', '', glbObsNew[, glbFeatsId]))"
    glbObsOut$vars[[glb_rsp_var]] <- 
        "%<d-% glbObsNew[, mygetPredictIds(glb_rsp_var, glbMdlFinId)$value]"
#     for (outVar in setdiff(glbFeatsExcludeLcl, glb_rsp_var_raw))
#         glbObsOut$vars[[outVar]] <- 
#             paste0("%<d-% mean(glbObsAll[, \"", outVar, "\"], na.rm = TRUE)")
}    
# glbObsOut$vars[[glb_rsp_var_raw]] <- glb_rsp_var_raw
# glbObsOut$vars[[paste0(head(unlist(strsplit(mygetPredictIds$value, "")), -1), collapse = "")]] <-

glbOutStackFnames <- NULL #: default
    # c("ebayipads_txt_assoc1_out_bid1_stack.csv") # manual stack
    # c("ebayipads_finmdl_bid1_out_nnet_1.csv") # universal stack

glbOut <- list(pfx = "Votes_Ensemble_cnk06_")
# lclImageSampleSeed <- 129
glbOutDataVizFname <- NULL # choose from c(NULL, "<projectId>_obsall.csv")


glbChunks <- list(labels = c("set_global_options_wd","set_global_options"
    ,"import.data","inspect.data","scrub.data","transform.data"
    ,"extract.features"
        ,"extract.features.datetime","extract.features.image","extract.features.price"
        ,"extract.features.text","extract.features.string"  
        ,"extract.features.end"
    ,"manage.missing.data","cluster.data","partition.data.training","select.features"
    ,"fit.models_0","fit.models_1","fit.models_2","fit.models_3"
    ,"fit.data.training_0","fit.data.training_1"
    ,"predict.data.new"         
    ,"display.session.info"))
# To ensure that all chunks in this script are in glbChunks
if (!is.null(chkChunksLabels <- knitr::all_labels()) && # knitr::all_labels() doesn't work in console runs
    !identical(chkChunksLabels, glbChunks$labels)) {
    print(sprintf("setdiff(chkChunksLabels, glbChunks$labels): %s", 
                  setdiff(chkChunksLabels, glbChunks$labels)))    
    print(sprintf("setdiff(glbChunks$labels, chkChunksLabels): %s", 
                  setdiff(glbChunks$labels, chkChunksLabels)))    
}

glbChunks[["first"]] <- "fit.models_2" #default: script will load envir from previous chunk
glbChunks[["last" ]] <- NULL # NULL #default: script will save envir at end of this chunk 
glbChunks[["inpFilePathName"]] <- "data/Votes_RFEXNOr_cnk05_fit.models_1_nomdllst.RData" # "data/<prvScriptName>_<lstChunkLbl>.RData"
#mysavChunk(glbOut$pfx, glbChunks[["last"]]) # called from myevlChunk
# Temporary: Delete this function (if any) from here after appropriate .RData file is saved

# Inspect max OOB FP
#chkObsOOB <- subset(glbObsOOB, !label.fctr.All.X..rcv.glmnet.is.acc)
#chkObsOOBFP <- subset(chkObsOOB, label.fctr.All.X..rcv.glmnet == "left_eye_center") %>% dplyr::mutate(Probability1 = label.fctr.All.X..rcv.glmnet.prob) %>% select(-.src, -.pos, -x, -y) %>% lclgetfltout_df() %>% mutate(obj.distance = (((as.numeric(x) - left_eye_center_x.int) ^ 2) + ((as.numeric(y) - left_eye_center_y.int) ^ 2)) ^ 0.5) %>% dplyr::top_n(5, obj.distance) %>% dplyr::top_n(5, -patch.cor)
#
#newImgObs <- glbObsNew[(glbObsNew$ImageId == "Test#0001"), ]; print(newImgObs[which.max(newImgObs$label.fctr.Final..rcv.glmnet.prob), ])
#OOBImgObs <- glbObsOOB[(glbObsOOB$ImageId == "Train#0003"), ]; print(OOBImgObs[which.max(OOBImgObs$label.fctr.All.X..rcv.glmnet.prob), ])

#mygetImage(which(glbObsAll[, glbFeatsId] == "Train#0003"), names(glbFeatsImage)[1], plot = TRUE, featHighlight = c("left_eye_center_x", "left_eye_center_y"), ovrlHighlight = c(66, 35))

# Depict process
glb_analytics_pn <- petrinet(name = "glb_analytics_pn",
                        trans_df = data.frame(id = 1:6,
    name = c("data.training.all","data.new",
           "model.selected","model.final",
           "data.training.all.prediction","data.new.prediction"),
    x=c(   -5,-5,-15,-25,-25,-35),
    y=c(   -5, 5,  0,  0, -5,  5)
                        ),
                        places_df=data.frame(id=1:4,
    name=c("bgn","fit.data.training.all","predict.data.new","end"),
    x=c(   -0,   -20,                    -30,               -40),
    y=c(    0,     0,                      0,                 0),
    M0=c(   3,     0,                      0,                 0)
                        ),
                        arcs_df = data.frame(
    begin = c("bgn","bgn","bgn",        
            "data.training.all","model.selected","fit.data.training.all",
            "fit.data.training.all","model.final",    
            "data.new","predict.data.new",
            "data.training.all.prediction","data.new.prediction"),
    end   = c("data.training.all","data.new","model.selected",
            "fit.data.training.all","fit.data.training.all","model.final",
            "data.training.all.prediction","predict.data.new",
            "predict.data.new","data.new.prediction",
            "end","end")
                        ))
#print(ggplot.petrinet(glb_analytics_pn))
print(ggplot.petrinet(glb_analytics_pn) + coord_flip())
## Loading required package: grid

glb_analytics_avl_objs <- NULL

glb_chunks_df <- myadd_chunk(NULL, 
                             ifelse(is.null(glbChunks$first), "import.data", glbChunks$first))
##          label step_major step_minor label_minor   bgn end elapsed
## 1 fit.models_2          1          0           0 7.063  NA      NA

Step 1.0: fit models_2

chunk option: eval=

Step 1.0: fit models_2

Step 1.0: fit models_2

Step 1.0: fit models_2

Step 1.0: fit models_2

Step 1.0: fit models_2

Step 1.0: fit models_2

```{r extract.features.image, cache=FALSE, echo=FALSE, fig.height=5, fig.width=5, eval=myevlChunk(glbChunks, glbOut$pfx)}

Step 1.0: fit models_2

Step 1.0: fit models_2

Step 1.0: fit models_2

Step 1.0: fit models_2

Step 1.0: fit models_2

Step 1.0: fit models_2

```{r cluster.data, cache=FALSE, echo=FALSE, eval=myevlChunk(glbChunks, glbOut$pfx)}

Step 1.0: fit models_2

Step 1.0: fit models_2

```{r select.features, cache=FALSE, echo=FALSE, eval=myevlChunk(glbChunks, glbOut$pfx)}

Step 1.0: fit models_2

fit.models_0_chunk_df <- myadd_chunk(NULL, "fit.models_0_bgn", label.minor = "setup")
# load(paste0(glbOut$pfx, "dsk.RData"))

glbgetModelSelectFormula <- function() {
    model_evl_terms <- c(NULL)
    # min.aic.fit might not be avl
    lclMdlEvlCriteria <- 
        glbMdlMetricsEval[glbMdlMetricsEval %in% names(glb_models_df)]
    for (metric in lclMdlEvlCriteria)
        model_evl_terms <- c(model_evl_terms, 
                             ifelse(length(grep("max", metric)) > 0, "-", "+"), metric)
    if (glb_is_classification && glb_is_binomial)
        model_evl_terms <- c(model_evl_terms, "-", "opt.prob.threshold.OOB")
    model_sel_frmla <- as.formula(paste(c("~ ", model_evl_terms), collapse = " "))
    return(model_sel_frmla)
}

glbgetDisplayModelsDf <- function() {
    dsp_models_cols <- c("id", 
                    glbMdlMetricsEval[glbMdlMetricsEval %in% names(glb_models_df)],
                    grep("opt.", names(glb_models_df), fixed = TRUE, value = TRUE)) 
    dsp_models_df <- 
        #orderBy(glbgetModelSelectFormula(), glb_models_df)[, c("id", glbMdlMetricsEval)]
        orderBy(glbgetModelSelectFormula(), glb_models_df)[, dsp_models_cols]    
    nCvMdl <- sapply(glb_models_lst, function(mdl) nrow(mdl$results))
    nParams <- sapply(glb_models_lst, function(mdl) ifelse(mdl$method == "custom", 0, 
        nrow(subset(modelLookup(mdl$method), parameter != "parameter"))))
    
#     nCvMdl <- nCvMdl[names(nCvMdl) != "avNNet"]
#     nParams <- nParams[names(nParams) != "avNNet"]    
    
    if (length(cvMdlProblems <- nCvMdl[nCvMdl <= nParams]) > 0) {
        print("Cross Validation issues:")
        warning("Cross Validation issues:")        
        print(cvMdlProblems)
    }
    
    pltMdls <- setdiff(names(nCvMdl), names(cvMdlProblems))
    pltMdls <- setdiff(pltMdls, names(nParams[nParams == 0]))
    
    # length(pltMdls) == 21
    png(paste0(glbOut$pfx, "bestTune.png"), width = 480 * 2, height = 480 * 4)
    grid.newpage()
    pushViewport(viewport(layout = grid.layout(ceiling(length(pltMdls) / 2.0), 2)))
    pltIx <- 1
    for (mdlId in pltMdls) {
        print(ggplot(glb_models_lst[[mdlId]], highBestTune = TRUE) + labs(title = mdlId),   
              vp = viewport(layout.pos.row = ceiling(pltIx / 2.0), 
                            layout.pos.col = ((pltIx - 1) %% 2) + 1))  
        pltIx <- pltIx + 1
    }
    dev.off()

    if (all(row.names(dsp_models_df) != dsp_models_df$id))
        row.names(dsp_models_df) <- dsp_models_df$id
    return(dsp_models_df)
}
#glbgetDisplayModelsDf()

if (glb_is_classification && glb_is_binomial && 
        (length(unique(glbObsFit[, glb_rsp_var])) < 2))
    stop("glbObsFit$", glb_rsp_var, ": contains less than 2 unique values: ",
         paste0(unique(glbObsFit[, glb_rsp_var]), collapse=", "))

max_cor_y_x_vars <- orderBy(~ -cor.y.abs, 
        subset(glb_feats_df, (exclude.as.feat == 0) & !nzv & !is.cor.y.abs.low & 
                                is.na(cor.high.X)))[1:2, "id"]
max_cor_y_x_vars <- max_cor_y_x_vars[!is.na(max_cor_y_x_vars)]
if (length(max_cor_y_x_vars) < 2)
    max_cor_y_x_vars <- union(max_cor_y_x_vars, ".pos")

if (!is.null(glb_Baseline_mdl_var)) {
    if ((max_cor_y_x_vars[1] != glb_Baseline_mdl_var) & 
        (glb_feats_df[glb_feats_df$id == max_cor_y_x_vars[1], "cor.y.abs"] > 
         glb_feats_df[glb_feats_df$id == glb_Baseline_mdl_var, "cor.y.abs"]))
        stop(max_cor_y_x_vars[1], " has a higher correlation with ", glb_rsp_var, 
             " than the Baseline var: ", glb_Baseline_mdl_var)
}

glb_model_type <- ifelse(glb_is_regression, "regression", "classification")
    
# Model specs
# c("id.prefix", "method", "type",
#   # trainControl params
#   "preProc.method", "cv.n.folds", "cv.n.repeats", "summary.fn",
#   # train params
#   "metric", "metric.maximize", "tune.df")

# Baseline
if (!is.null(glb_Baseline_mdl_var)) {
    fit.models_0_chunk_df <- myadd_chunk(fit.models_0_chunk_df, 
                            paste0("fit.models_0_", "Baseline"), major.inc = FALSE,
                                    label.minor = "mybaseln_classfr")
    ret_lst <- myfit_mdl(mdl_id="Baseline", 
                         model_method="mybaseln_classfr",
                        indepVar=glb_Baseline_mdl_var,
                        rsp_var=glb_rsp_var,
                        fit_df=glbObsFit, OOB_df=glbObsOOB)
}    

# Most Frequent Outcome "MFO" model: mean(y) for regression
#   Not using caret's nullModel since model stats not avl
#   Cannot use rpart for multinomial classification since it predicts non-MFO
if (glb_is_classification) {
    fit.models_0_chunk_df <- myadd_chunk(fit.models_0_chunk_df, 
                                paste0("fit.models_0_", "MFO"), major.inc = FALSE,
                                        label.minor = "myMFO_classfr")

    ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst = list(
        id.prefix = "MFO", type = glb_model_type, trainControl.method = "none",
        train.method = ifelse(glb_is_regression, "lm", "myMFO_classfr"))),
                            indepVar = ".rnorm", rsp_var = glb_rsp_var,
                            fit_df = glbObsFit, OOB_df = glbObsOOB)

        # "random" model - only for classification; 
        #   none needed for regression since it is same as MFO
    fit.models_0_chunk_df <- myadd_chunk(fit.models_0_chunk_df, 
                                paste0("fit.models_0_", "Random"), major.inc = FALSE,
                                        label.minor = "myrandom_classfr")

#stop(here"); glb2Sav(); all.equal(glb_models_df, sav_models_df)    
    ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst = list(
        id.prefix = "Random", type = glb_model_type, trainControl.method = "none",
        train.method = "myrandom_classfr")),
                        indepVar = ".rnorm", rsp_var = glb_rsp_var,
                        fit_df = glbObsFit, OOB_df = glbObsOOB)
}

# Max.cor.Y
#   Check impact of cv
#       rpart is not a good candidate since caret does not optimize cp (only tuning parameter of rpart) well
fit.models_0_chunk_df <- myadd_chunk(fit.models_0_chunk_df, 
                        paste0("fit.models_0_", "Max.cor.Y.rcv.*X*"), major.inc = FALSE,
                                    label.minor = "glmnet")

ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst = list(
    id.prefix = "Max.cor.Y.rcv.1X1", type = glb_model_type, trainControl.method = "none",
    train.method = "glmnet")),
                    indepVar = max_cor_y_x_vars, rsp_var = glb_rsp_var, 
                    fit_df = glbObsFit, OOB_df = glbObsOOB)

if (glbMdlCheckRcv) {
    # rcv_n_folds == 1 & rcv_n_repeats > 1 crashes
    for (rcv_n_folds in seq(3, glb_rcv_n_folds + 2, 2))
        for (rcv_n_repeats in seq(1, glb_rcv_n_repeats + 2, 2)) {
            
            # Experiment specific code to avoid caret crash
    #         lcl_tune_models_df <- rbind(data.frame()
    #                             ,data.frame(method = "glmnet", parameter = "alpha", 
    #                                         vals = "0.100 0.325 0.550 0.775 1.000")
    #                             ,data.frame(method = "glmnet", parameter = "lambda",
    #                                         vals = "9.342e-02")    
    #                                     )
            
            ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst =
                list(
                id.prefix = paste0("Max.cor.Y.rcv.", rcv_n_folds, "X", rcv_n_repeats), 
                type = glb_model_type, 
    # tune.df = lcl_tune_models_df,            
                trainControl.method = "repeatedcv",
                trainControl.number = rcv_n_folds, 
                trainControl.repeats = rcv_n_repeats,
                trainControl.classProbs = glb_is_classification,
                trainControl.summaryFunction = glbMdlMetricSummaryFn,
                train.method = "glmnet", train.metric = glbMdlMetricSummary, 
                train.maximize = glbMdlMetricMaximize)),
                                indepVar = max_cor_y_x_vars, rsp_var = glb_rsp_var, 
                                fit_df = glbObsFit, OOB_df = glbObsOOB)
        }
    # Add parallel coordinates graph of glb_models_df[, glbMdlMetricsEval] to evaluate cv parameters
    tmp_models_cols <- c("id", "max.nTuningRuns",
                        glbMdlMetricsEval[glbMdlMetricsEval %in% names(glb_models_df)],
                        grep("opt.", names(glb_models_df), fixed = TRUE, value = TRUE)) 
    print(myplot_parcoord(obs_df = subset(glb_models_df, 
                                          grepl("Max.cor.Y.rcv.", id, fixed = TRUE), 
                                            select = -feats)[, tmp_models_cols],
                          id_var = "id"))
}
        
# Useful for stacking decisions
# fit.models_0_chunk_df <- myadd_chunk(fit.models_0_chunk_df, 
#                     paste0("fit.models_0_", "Max.cor.Y[rcv.1X1.cp.0|]"), major.inc = FALSE,
#                                     label.minor = "rpart")
# 
# ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst = list(
#     id.prefix = "Max.cor.Y.rcv.1X1.cp.0", type = glb_model_type, trainControl.method = "none",
#     train.method = "rpart",
#     tune.df=data.frame(method="rpart", parameter="cp", min=0.0, max=0.0, by=0.1))),
#                     indepVar=max_cor_y_x_vars, rsp_var=glb_rsp_var, 
#                     fit_df=glbObsFit, OOB_df=glbObsOOB)

#stop(here"); glb2Sav(); all.equal(glb_models_df, sav_models_df)
# if (glb_is_regression || glb_is_binomial) # For multinomials this model will be run next by default
ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst = list(
                        id.prefix = "Max.cor.Y", 
                        type = glb_model_type, trainControl.method = "repeatedcv",
                        trainControl.number = glb_rcv_n_folds, 
                        trainControl.repeats = glb_rcv_n_repeats,
                        trainControl.classProbs = glb_is_classification,
                        trainControl.summaryFunction = glbMdlMetricSummaryFn,
                        trainControl.allowParallel = glbMdlAllowParallel,                        
                        train.metric = glbMdlMetricSummary, 
                        train.maximize = glbMdlMetricMaximize,    
                        train.method = "rpart")),
                    indepVar = max_cor_y_x_vars, rsp_var = glb_rsp_var, 
                    fit_df = glbObsFit, OOB_df = glbObsOOB)

if ((length(glbFeatsDateTime) > 0) && 
    (sum(grepl(paste(names(glbFeatsDateTime), "\\.day\\.minutes\\.poly\\.", sep = ""),
               names(glbObsAll))) > 0)) {
    fit.models_0_chunk_df <- myadd_chunk(fit.models_0_chunk_df, 
                    paste0("fit.models_0_", "Max.cor.Y.Time.Poly"), major.inc = FALSE,
                                    label.minor = "glmnet")

    indepVars <- c(max_cor_y_x_vars, 
            grep(paste(names(glbFeatsDateTime), "\\.day\\.minutes\\.poly\\.", sep = ""),
                        names(glbObsAll), value = TRUE))
    indepVars <- myadjustInteractionFeats(glb_feats_df, indepVars)
    ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst = list(
            id.prefix = "Max.cor.Y.Time.Poly", 
            type = glb_model_type, trainControl.method = "repeatedcv",
            trainControl.number = glb_rcv_n_folds, trainControl.repeats = glb_rcv_n_repeats,
            trainControl.classProbs = glb_is_classification,
            trainControl.summaryFunction = glbMdlMetricSummaryFn,
            trainControl.allowParallel = glbMdlAllowParallel,            
            train.metric = glbMdlMetricSummary, 
            train.maximize = glbMdlMetricMaximize,    
            train.method = "glmnet")),
        indepVar = indepVars,
        rsp_var = glb_rsp_var, 
        fit_df = glbObsFit, OOB_df = glbObsOOB)
}

if ((length(glbFeatsDateTime) > 0) && 
    (sum(grepl(paste(names(glbFeatsDateTime), "\\.last[[:digit:]]", sep = ""),
               names(glbObsAll))) > 0)) {
    fit.models_0_chunk_df <- myadd_chunk(fit.models_0_chunk_df, 
                    paste0("fit.models_0_", "Max.cor.Y.Time.Lag"), major.inc = FALSE,
                                    label.minor = "glmnet")

    indepVars <- c(max_cor_y_x_vars, 
            grep(paste(names(glbFeatsDateTime), "\\.last[[:digit:]]", sep = ""),
                        names(glbObsAll), value = TRUE))
    indepVars <- myadjustInteractionFeats(glb_feats_df, indepVars)
    ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst = list(
        id.prefix = "Max.cor.Y.Time.Lag", 
        type = glb_model_type, 
        tune.df = glbMdlTuneParams,        
        trainControl.method = "repeatedcv",
        trainControl.number = glb_rcv_n_folds, trainControl.repeats = glb_rcv_n_repeats,
        trainControl.classProbs = glb_is_classification,
        trainControl.summaryFunction = glbMdlMetricSummaryFn,
        trainControl.allowParallel = glbMdlAllowParallel,        
        train.metric = glbMdlMetricSummary, 
        train.maximize = glbMdlMetricMaximize,    
        train.method = "glmnet")),
        indepVar = indepVars,
        rsp_var = glb_rsp_var, 
        fit_df = glbObsFit, OOB_df = glbObsOOB)
}

if (length(glbFeatsText) > 0) {
    fit.models_0_chunk_df <- myadd_chunk(fit.models_0_chunk_df, 
                    paste0("fit.models_0_", "Txt.*"), major.inc = FALSE,
                                    label.minor = "glmnet")

    indepVars <- c(max_cor_y_x_vars)
    for (txtFeat in names(glbFeatsText))
        indepVars <- union(indepVars, 
            grep(paste(str_to_upper(substr(txtFeat, 1, 1)), "\\.(?!([T|P]\\.))", sep = ""),
                        names(glbObsAll), perl = TRUE, value = TRUE))
    indepVars <- myadjustInteractionFeats(glb_feats_df, indepVars)
    ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst = list(
        id.prefix = "Max.cor.Y.Text.nonTP", 
        type = glb_model_type, 
        tune.df = glbMdlTuneParams,        
        trainControl.method = "repeatedcv",
        trainControl.number = glb_rcv_n_folds, trainControl.repeats = glb_rcv_n_repeats,
        trainControl.classProbs = glb_is_classification,
        trainControl.summaryFunction = glbMdlMetricSummaryFn,
        trainControl.allowParallel = glbMdlAllowParallel,                                
        train.metric = glbMdlMetricSummary, 
        train.maximize = glbMdlMetricMaximize,    
        train.method = "glmnet")),
        indepVar = indepVars,
        rsp_var = glb_rsp_var, 
        fit_df = glbObsFit, OOB_df = glbObsOOB)

    indepVars <- c(max_cor_y_x_vars)
    for (txtFeat in names(glbFeatsText))
        indepVars <- union(indepVars, 
            grep(paste(str_to_upper(substr(txtFeat, 1, 1)), "\\.T\\.", sep = ""),
                        names(glbObsAll), perl = TRUE, value = TRUE))
    indepVars <- myadjustInteractionFeats(glb_feats_df, indepVars)
    ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst = list(
        id.prefix = "Max.cor.Y.Text.onlyT", 
        type = glb_model_type, 
        tune.df = glbMdlTuneParams,        
        trainControl.method = "repeatedcv",
        trainControl.number = glb_rcv_n_folds, trainControl.repeats = glb_rcv_n_repeats,
        trainControl.classProbs = glb_is_classification,
        trainControl.summaryFunction = glbMdlMetricSummaryFn,
        train.metric = glbMdlMetricSummary, 
        train.maximize = glbMdlMetricMaximize,    
        train.method = "glmnet")),
        indepVar = indepVars,
        rsp_var = glb_rsp_var, 
        fit_df = glbObsFit, OOB_df = glbObsOOB)

    indepVars <- c(max_cor_y_x_vars)
    for (txtFeat in names(glbFeatsText))
        indepVars <- union(indepVars, 
            grep(paste(str_to_upper(substr(txtFeat, 1, 1)), "\\.P\\.", sep = ""),
                        names(glbObsAll), perl = TRUE, value = TRUE))
    indepVars <- myadjustInteractionFeats(glb_feats_df, indepVars)
    ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst = list(
        id.prefix = "Max.cor.Y.Text.onlyP", 
        type = glb_model_type, 
        tune.df = glbMdlTuneParams,        
        trainControl.method = "repeatedcv",
        trainControl.number = glb_rcv_n_folds, trainControl.repeats = glb_rcv_n_repeats,
        trainControl.classProbs = glb_is_classification,
        trainControl.summaryFunction = glbMdlMetricSummaryFn,
        trainControl.allowParallel = glbMdlAllowParallel,        
        train.metric = glbMdlMetricSummary, 
        train.maximize = glbMdlMetricMaximize,    
        train.method = "glmnet")),
        indepVar = indepVars,
        rsp_var = glb_rsp_var, 
        fit_df = glbObsFit, OOB_df = glbObsOOB)
}

# Interactions.High.cor.Y
if (length(int_feats <- setdiff(setdiff(unique(glb_feats_df$cor.high.X), NA), 
                                subset(glb_feats_df, nzv)$id)) > 0) {
    fit.models_0_chunk_df <- myadd_chunk(fit.models_0_chunk_df, 
                    paste0("fit.models_0_", "Interact.High.cor.Y"), major.inc = FALSE,
                                    label.minor = "glmnet")

    ret_lst <- myfit_mdl(mdl_specs_lst=myinit_mdl_specs_lst(mdl_specs_lst=list(
        id.prefix="Interact.High.cor.Y", 
        type=glb_model_type, trainControl.method="repeatedcv",
        trainControl.number=glb_rcv_n_folds, trainControl.repeats=glb_rcv_n_repeats,
        trainControl.classProbs = glb_is_classification,
        trainControl.summaryFunction = glbMdlMetricSummaryFn,
        trainControl.allowParallel = glbMdlAllowParallel,
        train.metric = glbMdlMetricSummary, 
        train.maximize = glbMdlMetricMaximize,    
        train.method="glmnet")),
        indepVar=c(max_cor_y_x_vars, paste(max_cor_y_x_vars[1], int_feats, sep=":")),
        rsp_var=glb_rsp_var, 
        fit_df=glbObsFit, OOB_df=glbObsOOB)
}    

# Low.cor.X
fit.models_0_chunk_df <- myadd_chunk(fit.models_0_chunk_df, 
                        paste0("fit.models_0_", "Low.cor.X"), major.inc = FALSE,
                                     label.minor = "glmnet")
indepVar <- mygetIndepVar(glb_feats_df)
ret_lst <- myfit_mdl(mdl_specs_lst = myinit_mdl_specs_lst(mdl_specs_lst = list(
            id.prefix = "Low.cor.X", 
            type = glb_model_type, 
            tune.df = glbMdlTuneParams,        
            trainControl.method = "repeatedcv",
            trainControl.number = glb_rcv_n_folds, trainControl.repeats = glb_rcv_n_repeats,
            trainControl.classProbs = glb_is_classification,
            trainControl.summaryFunction = glbMdlMetricSummaryFn,
            trainControl.allowParallel = glbMdlAllowParallel,
            train.metric = glbMdlMetricSummary, 
            train.maximize = glbMdlMetricMaximize,    
            train.method = "glmnet")),
        indepVar = indepVar, rsp_var = glb_rsp_var, 
        fit_df = glbObsFit, OOB_df = glbObsOOB)

fit.models_0_chunk_df <- 
    myadd_chunk(fit.models_0_chunk_df, "fit.models_0_end", major.inc = FALSE,
                label.minor = "teardown")

rm(ret_lst)

glb_chunks_df <- myadd_chunk(glb_chunks_df, "fit.models", major.inc = FALSE)

```{r fit.models_1, cache=FALSE, fig.height=10, fig.width=15, eval=myevlChunk(glbChunks, glbOut$pfx)}

```{r fit.models_2, cache=FALSE, fig.height=10, fig.width=15, eval=myevlChunk(glbChunks, glbOut$pfx)}

##              label step_major step_minor label_minor   bgn end elapsed
## 1 fit.models_2_bgn          1          0       setup 9.264  NA      NA
## Loading required package: reshape2
## Warning: max.AccuracyUpper.fit already exists in glb_models_df
## [1] "var:max.KappaSD.fit"
## Loading required package: RColorBrewer
## Warning: Removed 8 rows containing missing values (geom_errorbar).
## quartz_off_screen 
##                 2
## Warning: Removed 8 rows containing missing values (geom_errorbar).

##                                      id max.Accuracy.OOB max.AUCROCR.OOB
## 48              RFE.X.Inc##rcv#bagEarth        0.5838565       0.5840728
## 40                  RFE.X##rcv#bagEarth        0.5838565       0.5829523
## 39              RFE.X#zv.pca#rcv#glmnet        0.5829596       0.5816510
## 22     All.X#nzv.spatialSign#rcv#glmnet        0.5820628       0.5787416
## 20         All.X#spatialSign#rcv#glmnet        0.5811659       0.5793099
## 37     RFE.X#nzv.spatialSign#rcv#glmnet        0.5811659       0.5785672
## 23 All.X.Inc#nzv.spatialSign#rcv#glmnet        0.5811659       0.5734523
## 35         RFE.X#spatialSign#rcv#glmnet        0.5802691       0.5794035
## 10                 All.X#nzv#rcv#glmnet        0.5775785       0.5766539
## 26                 RFE.X#nzv#rcv#glmnet        0.5775785       0.5762019
## 13           All.X#expoTrans#rcv#glmnet        0.5775785       0.5745421
## 29           RFE.X#expoTrans#rcv#glmnet        0.5775785       0.5745421
## 12          All.X#YeoJohnson#rcv#glmnet        0.5775785       0.5744824
## 28          RFE.X#YeoJohnson#rcv#glmnet        0.5775785       0.5744824
## 43                     RFE.X##rcv#rpart        0.5775785       0.5547284
## 24                    RFE.X##rcv#glmnet        0.5766816       0.5757966
## 21        All.X#conditionalX#rcv#glmnet        0.5766816       0.5757966
## 7                     All.X##rcv#glmnet        0.5766816       0.5757966
## 6                 Low.cor.X##rcv#glmnet        0.5766816       0.5757966
## 36        RFE.X#conditionalX#rcv#glmnet        0.5766816       0.5757966
## 9                   All.X#zv#rcv#glmnet        0.5766816       0.5757966
## 25                  RFE.X#zv#rcv#glmnet        0.5766816       0.5757966
## 31               RFE.X#scale#rcv#glmnet        0.5766816       0.5757966
## 30              RFE.X#center#rcv#glmnet        0.5766816       0.5757966
## 15               All.X#scale#rcv#glmnet        0.5766816       0.5757966
## 14              All.X#center#rcv#glmnet        0.5766816       0.5757966
## 33               RFE.X#range#rcv#glmnet        0.5766816       0.5757966
## 27              RFE.X#BoxCox#rcv#glmnet        0.5766816       0.5757966
## 17               All.X#range#rcv#glmnet        0.5766816       0.5757966
## 11              All.X#BoxCox#rcv#glmnet        0.5766816       0.5757966
## 32        RFE.X#center.scale#rcv#glmnet        0.5766816       0.5757966
## 16        All.X#center.scale#rcv#glmnet        0.5766816       0.5757966
## 18              All.X#zv.pca#rcv#glmnet        0.5748879       0.5798104
## 44                       RFE.X##rcv#gbm        0.5730942       0.5783993
## 38 RFE.X#nzv.pca.spatialSign#rcv#glmnet        0.5713004       0.5742305
## 47                     RFE.X##rcv#earth        0.5677130       0.5720864
## 41                       RFE.X##rcv#glm        0.5668161       0.5690413
## 8                        All.X##rcv#glm        0.5650224       0.5687249
## 46                        RFE.X##rcv#rf        0.5650224       0.5510859
## 45                    RFE.X##rcv#avNNet        0.5632287       0.5713598
## 42                      RFE.X##rcv#nnet        0.5623318       0.5667713
## 34                 RFE.X#ica#rcv#glmnet        0.5363229       0.5370894
## 19                 All.X#ica#rcv#glmnet        0.5354260       0.5360626
## 5       Interact.High.cor.Y##rcv#glmnet        0.5345291       0.5242069
## 2             Random###myrandom_classfr        0.5300448       0.5181895
## 3            Max.cor.Y.rcv.1X1###glmnet        0.5300448       0.5102459
## 4                  Max.cor.Y##rcv#rpart        0.5300448       0.5000646
## 1                   MFO###myMFO_classfr        0.5300448       0.5000000
##    max.AUCpROC.OOB min.elapsedtime.everything max.Accuracy.fit
## 48       0.5671007                   1752.739        0.6169886
## 40       0.5601161                    884.423        0.6288811
## 39       0.5792308                     74.676        0.6459313
## 22       0.5572148                     52.416        0.6478785
## 20       0.5570372                     36.885        0.6492270
## 37       0.5597528                     51.794        0.6462317
## 23       0.5556503                     67.172        0.6440612
## 35       0.5570372                     46.699        0.6490772
## 10       0.5550900                     36.115        0.6475806
## 26       0.5531816                     34.109        0.6466826
## 13       0.5559554                     70.569        0.6463076
## 29       0.5559554                     71.462        0.6462327
## 12       0.5559554                     58.542        0.6465321
## 28       0.5559554                     84.187        0.6466820
## 43       0.5677723                     15.749        0.6207805
## 24       0.5588180                     21.949        0.6475052
## 21       0.5588180                     22.580        0.6471308
## 7        0.5588180                     22.609        0.6471308
## 6        0.5588180                     22.775        0.6471308
## 36       0.5588180                     23.022        0.6475052
## 9        0.5588180                     23.568        0.6471308
## 25       0.5588180                     24.269        0.6475052
## 31       0.5588180                     25.649        0.6475052
## 30       0.5588180                     25.755        0.6475052
## 15       0.5588180                     26.279        0.6471308
## 14       0.5588180                     26.891        0.6471308
## 33       0.5588180                     27.116        0.6475052
## 27       0.5588180                     28.258        0.6475052
## 17       0.5588180                     28.776        0.6471308
## 11       0.5588180                     29.405        0.6471308
## 32       0.5588180                     29.657        0.6475052
## 16       0.5588180                     30.287        0.6471308
## 18       0.5717247                     77.239        0.6421158
## 44       0.5638748                     81.851        0.6477310
## 38       0.5545298                    533.967        0.6480297
## 47       0.5641493                    166.648        0.6400213
## 41       0.5497475                     12.435        0.6255716
## 8        0.5487933                     14.312        0.6254219
## 46       0.5382083                     83.830        1.0000000
## 45       0.5593589                    182.550        0.6367252
## 42       0.5584628                     90.316        0.6155403
## 34       0.5121737                     39.908        0.5603719
## 19       0.5133442                     41.240        0.5607462
## 5        0.5218093                      5.284        0.6250526
## 2        0.4836608                      0.265        0.5299798
## 3        0.4999322                      0.753        0.6240737
## 4        0.4999322                      1.624        0.6227308
## 1        0.5000000                      0.399        0.5299798
##    opt.prob.threshold.fit opt.prob.threshold.OOB
## 48                   0.50                   0.60
## 40                   0.50                   0.60
## 39                   0.50                   0.50
## 22                   0.50                   0.60
## 20                   0.50                   0.60
## 37                   0.50                   0.60
## 23                   0.50                   0.60
## 35                   0.50                   0.60
## 10                   0.50                   0.60
## 26                   0.50                   0.55
## 13                   0.50                   0.55
## 29                   0.50                   0.55
## 12                   0.50                   0.55
## 28                   0.50                   0.55
## 43                   0.50                   0.50
## 24                   0.50                   0.55
## 21                   0.50                   0.55
## 7                    0.50                   0.55
## 6                    0.50                   0.55
## 36                   0.50                   0.55
## 9                    0.50                   0.55
## 25                   0.50                   0.55
## 31                   0.50                   0.55
## 30                   0.50                   0.55
## 15                   0.50                   0.55
## 14                   0.50                   0.55
## 33                   0.50                   0.55
## 27                   0.50                   0.55
## 17                   0.50                   0.55
## 11                   0.50                   0.55
## 32                   0.50                   0.55
## 16                   0.50                   0.55
## 18                   0.50                   0.50
## 44                   0.50                   0.60
## 38                   0.50                   0.55
## 47                   0.50                   0.60
## 41                   0.50                   0.65
## 8                    0.50                   0.65
## 46                   0.50                   0.65
## 45                   0.50                   0.65
## 42                   0.50                   0.65
## 34                   0.50                   0.55
## 19                   0.50                   0.55
## 5                    0.50                   0.70
## 2                    0.55                   0.55
## 3                    0.45                   0.65
## 4                    0.50                   0.65
## 1                    0.50                   0.50
## [1] "Metrics used for model selection:"
## ~-max.Accuracy.OOB - max.AUCROCR.OOB - max.AUCpROC.OOB + min.elapsedtime.everything - 
##     max.Accuracy.fit - opt.prob.threshold.OOB
## <environment: 0x7fd6bee61e98>
## [1] "Best model id: RFE.X.Inc##rcv#bagEarth"
##                   label step_major step_minor label_minor    bgn    end
## 1      fit.models_2_bgn          1          0       setup  9.264 12.933
## 2 fit.models_2_Ensemble          2          0    ensemble 12.934     NA
##   elapsed
## 1    3.67
## 2      NA
## [1] "cor(Party.fctr.All.X..rcv.glmnet.prob, Party.fctr.All.X.BoxCox.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X..rcv.glmnet.prob)=0.3416"
## [1] "cor(Party.fctr, Party.fctr.All.X.BoxCox.rcv.glmnet.prob)=0.3416"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.BoxCox.rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X..rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X..rcv.glmnet.prob, Party.fctr.All.X.center.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X..rcv.glmnet.prob)=0.3416"
## [1] "cor(Party.fctr, Party.fctr.All.X.center.rcv.glmnet.prob)=0.3416"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.center.rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X..rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X..rcv.glmnet.prob, Party.fctr.All.X.center.scale.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X..rcv.glmnet.prob)=0.3416"
## [1] "cor(Party.fctr, Party.fctr.All.X.center.scale.rcv.glmnet.prob)=0.3416"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.center.scale.rcv.glmnet.prob as
## highly correlated with Party.fctr.All.X..rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X..rcv.glmnet.prob, Party.fctr.All.X.conditionalX.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X..rcv.glmnet.prob)=0.3416"
## [1] "cor(Party.fctr, Party.fctr.All.X.conditionalX.rcv.glmnet.prob)=0.3416"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.conditionalX.rcv.glmnet.prob as
## highly correlated with Party.fctr.All.X..rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X..rcv.glmnet.prob, Party.fctr.All.X.range.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X..rcv.glmnet.prob)=0.3416"
## [1] "cor(Party.fctr, Party.fctr.All.X.range.rcv.glmnet.prob)=0.3416"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X..rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X.range.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob, Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob)=0.3172"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob)=0.3172"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob as
## highly correlated with Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.expoTrans.rcv.glmnet.prob, Party.fctr.RFE.X.expoTrans.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X.expoTrans.rcv.glmnet.prob)=0.3373"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.expoTrans.rcv.glmnet.prob)=0.3373"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X.expoTrans.rcv.glmnet.prob as
## highly correlated with Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.range.rcv.glmnet.prob, Party.fctr.All.X.scale.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X.range.rcv.glmnet.prob)=0.3416"
## [1] "cor(Party.fctr, Party.fctr.All.X.scale.rcv.glmnet.prob)=0.3416"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.scale.rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X.range.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.range.rcv.glmnet.prob, Party.fctr.All.X.zv.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X.range.rcv.glmnet.prob)=0.3416"
## [1] "cor(Party.fctr, Party.fctr.All.X.zv.rcv.glmnet.prob)=0.3416"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.zv.rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X.range.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.range.rcv.glmnet.prob, Party.fctr.Low.cor.X..rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X.range.rcv.glmnet.prob)=0.3416"
## [1] "cor(Party.fctr, Party.fctr.Low.cor.X..rcv.glmnet.prob)=0.3416"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.Low.cor.X..rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X.range.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.range.rcv.glmnet.prob, Party.fctr.RFE.X..rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X.range.rcv.glmnet.prob)=0.3416"
## [1] "cor(Party.fctr, Party.fctr.RFE.X..rcv.glmnet.prob)=0.3416"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X..rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X.range.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.range.rcv.glmnet.prob, Party.fctr.RFE.X.BoxCox.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X.range.rcv.glmnet.prob)=0.3416"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.BoxCox.rcv.glmnet.prob)=0.3416"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X.BoxCox.rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X.range.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.range.rcv.glmnet.prob, Party.fctr.RFE.X.center.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X.range.rcv.glmnet.prob)=0.3416"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.center.rcv.glmnet.prob)=0.3416"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X.center.rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X.range.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.range.rcv.glmnet.prob, Party.fctr.RFE.X.center.scale.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X.range.rcv.glmnet.prob)=0.3416"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.center.scale.rcv.glmnet.prob)=0.3416"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X.center.scale.rcv.glmnet.prob as
## highly correlated with Party.fctr.All.X.range.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.range.rcv.glmnet.prob, Party.fctr.RFE.X.conditionalX.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X.range.rcv.glmnet.prob)=0.3416"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.conditionalX.rcv.glmnet.prob)=0.3416"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X.conditionalX.rcv.glmnet.prob as
## highly correlated with Party.fctr.All.X.range.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.range.rcv.glmnet.prob, Party.fctr.RFE.X.range.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X.range.rcv.glmnet.prob)=0.3416"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.range.rcv.glmnet.prob)=0.3416"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.range.rcv.glmnet.prob as highly
## correlated with Party.fctr.RFE.X.range.rcv.glmnet.prob
## [1] "cor(Party.fctr.RFE.X.range.rcv.glmnet.prob, Party.fctr.RFE.X.scale.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.range.rcv.glmnet.prob)=0.3416"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.scale.rcv.glmnet.prob)=0.3416"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X.scale.rcv.glmnet.prob as highly
## correlated with Party.fctr.RFE.X.range.rcv.glmnet.prob
## [1] "cor(Party.fctr.RFE.X.range.rcv.glmnet.prob, Party.fctr.RFE.X.zv.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.range.rcv.glmnet.prob)=0.3416"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.zv.rcv.glmnet.prob)=0.3416"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X.zv.rcv.glmnet.prob as highly
## correlated with Party.fctr.RFE.X.range.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.spatialSign.rcv.glmnet.prob, Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob)=1.0000"
## [1] "cor(Party.fctr, Party.fctr.All.X.spatialSign.rcv.glmnet.prob)=0.3460"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob)=0.3461"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.spatialSign.rcv.glmnet.prob as
## highly correlated with Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.nzv.rcv.glmnet.prob, Party.fctr.RFE.X.nzv.rcv.glmnet.prob)=0.9999"
## [1] "cor(Party.fctr, Party.fctr.All.X.nzv.rcv.glmnet.prob)=0.3547"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.nzv.rcv.glmnet.prob)=0.3543"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X.nzv.rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X.nzv.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob, Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.prob)=0.9998"
## [1] "cor(Party.fctr, Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob)=0.3588"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.prob)=0.3584"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.prob
## as highly correlated with Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.ica.rcv.glmnet.prob, Party.fctr.RFE.X.ica.rcv.glmnet.prob)=0.9989"
## [1] "cor(Party.fctr, Party.fctr.All.X.ica.rcv.glmnet.prob)=0.1197"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.ica.rcv.glmnet.prob)=0.1193"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X.ica.rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X.ica.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X..rcv.glm.prob, Party.fctr.RFE.X..rcv.glm.prob)=0.9986"
## [1] "cor(Party.fctr, Party.fctr.All.X..rcv.glm.prob)=0.3899"
## [1] "cor(Party.fctr, Party.fctr.RFE.X..rcv.glm.prob)=0.3893"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X..rcv.glm.prob as highly
## correlated with Party.fctr.All.X..rcv.glm.prob
## [1] "cor(Party.fctr.RFE.X.range.rcv.glmnet.prob, Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob)=0.9971"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.range.rcv.glmnet.prob)=0.3416"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob)=0.3461"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X.range.rcv.glmnet.prob as highly
## correlated with Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.nzv.rcv.glmnet.prob, Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob)=0.9963"
## [1] "cor(Party.fctr, Party.fctr.All.X.nzv.rcv.glmnet.prob)=0.3547"
## [1] "cor(Party.fctr, Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob)=0.3588"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.nzv.rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## [1] "cor(Party.fctr.RFE.X..rcv.bagEarth.prob, Party.fctr.RFE.X.Inc..rcv.bagEarth.prob)=0.9908"
## [1] "cor(Party.fctr, Party.fctr.RFE.X..rcv.bagEarth.prob)=0.3700"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.Inc..rcv.bagEarth.prob)=0.3758"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X..rcv.bagEarth.prob as highly
## correlated with Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## [1] "cor(Party.fctr.RFE.X..rcv.gbm.prob, Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob)=0.9874"
## [1] "cor(Party.fctr, Party.fctr.RFE.X..rcv.gbm.prob)=0.3378"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob)=0.3461"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X..rcv.gbm.prob as highly
## correlated with Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.prob, Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob)=0.9872"
## [1] "cor(Party.fctr, Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.prob)=0.3559"
## [1] "cor(Party.fctr, Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob)=0.3588"
## Warning in myfind_cor_features(feats_df =
## mdlEnsembleDf, obs_df = glbObsTrn[, : Identified
## Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.prob as highly correlated
## with Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.zv.pca.rcv.glmnet.prob, Party.fctr.RFE.X.zv.pca.rcv.glmnet.prob)=0.9842"
## [1] "cor(Party.fctr, Party.fctr.All.X.zv.pca.rcv.glmnet.prob)=0.3640"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.zv.pca.rcv.glmnet.prob)=0.3550"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X.zv.pca.rcv.glmnet.prob as highly
## correlated with Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.expoTrans.rcv.glmnet.prob, Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob)=0.9817"
## [1] "cor(Party.fctr, Party.fctr.All.X.expoTrans.rcv.glmnet.prob)=0.3373"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob)=0.3461"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.expoTrans.rcv.glmnet.prob as
## highly correlated with Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob, Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob)=0.9768"
## [1] "cor(Party.fctr, Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob)=0.3588"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob)=0.3461"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob as
## highly correlated with Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## [1] "cor(Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob, Party.fctr.RFE.X.Inc..rcv.bagEarth.prob)=0.9633"
## [1] "cor(Party.fctr, Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob)=0.3588"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.Inc..rcv.bagEarth.prob)=0.3758"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## as highly correlated with Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## [1] "cor(Party.fctr.All.X.zv.pca.rcv.glmnet.prob, Party.fctr.RFE.X.Inc..rcv.bagEarth.prob)=0.9529"
## [1] "cor(Party.fctr, Party.fctr.All.X.zv.pca.rcv.glmnet.prob)=0.3640"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.Inc..rcv.bagEarth.prob)=0.3758"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X.zv.pca.rcv.glmnet.prob as highly
## correlated with Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## [1] "cor(Party.fctr.RFE.X..rcv.earth.prob, Party.fctr.RFE.X.Inc..rcv.bagEarth.prob)=0.9498"
## [1] "cor(Party.fctr, Party.fctr.RFE.X..rcv.earth.prob)=0.3392"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.Inc..rcv.bagEarth.prob)=0.3758"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X..rcv.earth.prob as highly
## correlated with Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## [1] "cor(Party.fctr.RFE.X.Inc..rcv.bagEarth.prob, Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.prob)=0.9269"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.Inc..rcv.bagEarth.prob)=0.3758"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.prob)=0.3250"
## Warning in myfind_cor_features(feats_df =
## mdlEnsembleDf, obs_df = glbObsTrn[, : Identified
## Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.prob as highly correlated
## with Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## [1] "cor(Party.fctr.All.X..rcv.glm.prob, Party.fctr.RFE.X.Inc..rcv.bagEarth.prob)=0.9256"
## [1] "cor(Party.fctr, Party.fctr.All.X..rcv.glm.prob)=0.3899"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.Inc..rcv.bagEarth.prob)=0.3758"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X.Inc..rcv.bagEarth.prob as highly
## correlated with Party.fctr.All.X..rcv.glm.prob
## [1] "cor(Party.fctr.All.X..rcv.glm.prob, Party.fctr.RFE.X..rcv.nnet.prob)=0.8296"
## [1] "cor(Party.fctr, Party.fctr.All.X..rcv.glm.prob)=0.3899"
## [1] "cor(Party.fctr, Party.fctr.RFE.X..rcv.nnet.prob)=0.4019"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.All.X..rcv.glm.prob as highly
## correlated with Party.fctr.RFE.X..rcv.nnet.prob
## [1] "cor(Party.fctr.RFE.X..rcv.rpart.prob, Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob)=0.8277"
## [1] "cor(Party.fctr, Party.fctr.RFE.X..rcv.rpart.prob)=0.2917"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob)=0.3172"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X..rcv.rpart.prob as highly
## correlated with Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## [1] "cor(Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob, Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob)=0.8108"
## [1] "cor(Party.fctr, Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob)=0.2956"
## [1] "cor(Party.fctr, Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob)=0.3172"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob as
## highly correlated with Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## [1] "cor(Party.fctr.RFE.X..rcv.avNNet.prob, Party.fctr.RFE.X..rcv.nnet.prob)=0.8072"
## [1] "cor(Party.fctr, Party.fctr.RFE.X..rcv.avNNet.prob)=0.5679"
## [1] "cor(Party.fctr, Party.fctr.RFE.X..rcv.nnet.prob)=0.4019"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X..rcv.nnet.prob as highly
## correlated with Party.fctr.RFE.X..rcv.avNNet.prob
## [1] "cor(Party.fctr.RFE.X..rcv.avNNet.prob, Party.fctr.RFE.X..rcv.rf.prob)=0.7359"
## [1] "cor(Party.fctr, Party.fctr.RFE.X..rcv.avNNet.prob)=0.5679"
## [1] "cor(Party.fctr, Party.fctr.RFE.X..rcv.rf.prob)=0.8630"
## Warning in myfind_cor_features(feats_df = mdlEnsembleDf, obs_df =
## glbObsTrn[, : Identified Party.fctr.RFE.X..rcv.avNNet.prob as highly
## correlated with Party.fctr.RFE.X..rcv.rf.prob
## [1] "myfit_mdl: enter: 0.001000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.1##rcv#glmnet"
## [1] "    indepVar: Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm"
## [1] "myfit_mdl: setup complete: 0.656000 secs"
## Loading required package: glmnet
## Loading required package: Matrix
## Loaded glmnet 2.0-5
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.00437 on full training set
## [1] "myfit_mdl: train complete: 3.159000 secs"
## Warning in plotCoef(x$beta, lambda = x$lambda, df = x$df, dev = x
## $dev.ratio, : 1 or less nonzero coefficients; glmnet plot is not meaningful

##             Length Class      Mode     
## a0           54    -none-     numeric  
## beta        108    dgCMatrix  S4       
## df           54    -none-     numeric  
## dim           2    -none-     numeric  
## lambda       54    -none-     numeric  
## dev.ratio    54    -none-     numeric  
## nulldev       1    -none-     numeric  
## npasses       1    -none-     numeric  
## jerr          1    -none-     numeric  
## offset        1    -none-     logical  
## classnames    2    -none-     character
## call          5    -none-     call     
## nobs          1    -none-     numeric  
## lambdaOpt     1    -none-     numeric  
## xNames        2    -none-     character
## problemType   1    -none-     character
## tuneValue     2    data.frame list     
## obsLevels     2    -none-     character
## [1] "min lambda > lambdaOpt:"
##                             (Intercept) 
##                               -2.674041 
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                                5.297383 
## [1] "max lambda < lambdaOpt:"
##                             (Intercept) 
##                               -2.681547 
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                                5.312568 
## [1] "myfit_mdl: train diagnostics complete: 3.662000 secs"
## Loading required namespace: pROC
## Loading required package: ROCR
## Loading required package: gplots
## 
## Attaching package: 'gplots'
## The following object is masked from 'package:stats':
## 
##     lowess

## Loading required package: sqldf
## Loading required package: gsubfn
## Loading required package: proto
## Loading required package: RSQLite
## Loading required package: DBI
## Loading required package: tcltk

##          Prediction
## Reference    D    R
##         D 1672  688
##         R  716 1377
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   6.847069e-01   3.666594e-01   6.708300e-01   6.983413e-01   5.299798e-01 
## AccuracyPValue  McnemarPValue 
##   4.967183e-98   4.711700e-01

##          Prediction
## Reference   D   R
##         D 506  85
##         R 377 147
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   5.856502e-01   1.411694e-01   5.560929e-01   6.147544e-01   5.300448e-01 
## AccuracyPValue  McnemarPValue 
##   1.072064e-04   9.260468e-42 
## [1] "myfit_mdl: predict complete: 18.830000 secs"
##                            id
## 1 Ensemble.auto.1##rcv#glmnet
##                                            feats max.nTuningRuns
## 1 Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm              20
##   min.elapsedtime.everything min.elapsedtime.final max.AUCpROC.fit
## 1                      2.493                 0.038       0.6831909
##   max.Sens.fit max.Spec.fit max.AUCROCR.fit opt.prob.threshold.fit
## 1    0.7084746    0.6579073       0.7525082                    0.5
##   max.f.score.fit max.Accuracy.fit max.AccuracyLower.fit
## 1       0.6623377        0.6842608               0.67083
##   max.AccuracyUpper.fit max.Kappa.fit max.AUCpROC.OOB max.Sens.OOB
## 1             0.6983413      0.365739       0.5677303    0.5972927
##   max.Spec.OOB max.AUCROCR.OOB opt.prob.threshold.OOB max.f.score.OOB
## 1    0.5381679       0.5840728                   0.65       0.3888889
##   max.Accuracy.OOB max.AccuracyLower.OOB max.AccuracyUpper.OOB
## 1        0.5856502             0.5560929             0.6147544
##   max.Kappa.OOB max.AccuracySD.fit max.KappaSD.fit
## 1     0.1411694         0.01430847      0.02877906
## [1] "myfit_mdl: exit: 18.950000 secs"
## glmnet variable importance
## 
##                                         Overall
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob     100
## .rnorm                                        0
##                                         Party.fctr.RFE.X..rcv.rf.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                     0.5849997
##                                         Party.fctr.RFE.X..rcv.avNNet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                         0.8074771
##                                         Party.fctr.RFE.X..rcv.nnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                       0.7891566
##                                         Party.fctr.All.X..rcv.glm.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                      0.9255725
##                                         Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                       1
##                                         Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                               0.9528914
##                                         Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                        0.9633405
##                                         Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                            0.9667987
##                                         Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                    0.9638358
##                                         Party.fctr.RFE.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                              0.9645156
##                                         Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                              0.9645156
##                                         Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                         0.9645156
##                                         Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.9532567
##                                         Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   0.8952551
##                                         Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                            0.3169478
##          Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                                        1.0000000 
##             Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                        0.9667987 
##           Party.fctr.RFE.X.range.rcv.glmnet.prob 
##                                        0.9645156 
##           Party.fctr.All.X.range.rcv.glmnet.prob 
##                                        0.9645156 
##                Party.fctr.All.X..rcv.glmnet.prob 
##                                        0.9645156 
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob 
##                                        0.9638358 
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob 
##                                        0.9633405 
##       Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                        0.9532567 
##          Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                        0.9528914 
##                   Party.fctr.All.X..rcv.glm.prob 
##                                        0.9255725 
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob 
##                                        0.8952551 
##                Party.fctr.RFE.X..rcv.avNNet.prob 
##                                        0.8074771 
##                  Party.fctr.RFE.X..rcv.nnet.prob 
##                                        0.7891566 
##                    Party.fctr.RFE.X..rcv.rf.prob 
##                                        0.5849997 
##             Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                        0.3169478 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.2##rcv#glmnet"
## [1] "    indepVar: Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.719000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.775, lambda = 0.000941 on full training set
## [1] "myfit_mdl: train complete: 3.089000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           54    -none-     numeric  
## beta        162    dgCMatrix  S4       
## df           54    -none-     numeric  
## dim           2    -none-     numeric  
## lambda       54    -none-     numeric  
## dev.ratio    54    -none-     numeric  
## nulldev       1    -none-     numeric  
## npasses       1    -none-     numeric  
## jerr          1    -none-     numeric  
## offset        1    -none-     logical  
## classnames    2    -none-     character
## call          5    -none-     call     
## nobs          1    -none-     numeric  
## lambdaOpt     1    -none-     numeric  
## xNames        3    -none-     character
## problemType   1    -none-     character
## tuneValue     2    data.frame list     
## obsLevels     2    -none-     character
## [1] "min lambda > lambdaOpt:"
##                             (Intercept) 
##                               -2.503402 
##    Party.fctr.All.X.ica.rcv.glmnet.prob 
##                               -0.530552 
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                                5.455579 
## [1] "max lambda < lambdaOpt:"
## [1] "Feats mismatch between coefs_left & rght:"
## [1] "(Intercept)"                            
## [2] ".rnorm"                                 
## [3] "Party.fctr.All.X.ica.rcv.glmnet.prob"   
## [4] "Party.fctr.RFE.X.Inc..rcv.bagEarth.prob"
## [1] "myfit_mdl: train diagnostics complete: 3.739000 secs"

##          Prediction
## Reference    D    R
##         D 1670  690
##         R  715 1378
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   6.844824e-01   3.662597e-01   6.706029e-01   6.981195e-01   5.299798e-01 
## AccuracyPValue  McnemarPValue 
##   9.570495e-98   5.219876e-01

##          Prediction
## Reference   D   R
##         D 505  86
##         R 373 151
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   5.883408e-01   1.472226e-01   5.588042e-01   6.174100e-01   5.300448e-01 
## AccuracyPValue  McnemarPValue 
##   5.162705e-05   1.195081e-40 
## [1] "myfit_mdl: predict complete: 17.710000 secs"
##                            id
## 1 Ensemble.auto.2##rcv#glmnet
##                                                                                 feats
## 1 Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              20                      2.362                 0.038
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.6830061    0.7076271    0.6583851        0.752414
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5       0.6623408        0.6846348
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.6706029             0.6981195     0.3665767
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1       0.5667761    0.5972927    0.5362595       0.5840502
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.65       0.3968463        0.5883408
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5588042               0.61741     0.1472226
##   max.AccuracySD.fit max.KappaSD.fit
## 1         0.01270635      0.02553761
## [1] "myfit_mdl: exit: 17.831000 secs"
## glmnet variable importance
## 
##                                         Overall
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 100.000
## Party.fctr.All.X.ica.rcv.glmnet.prob      9.725
## .rnorm                                    0.000
##                                         Party.fctr.RFE.X..rcv.rf.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                     0.5849997
## Party.fctr.All.X.ica.rcv.glmnet.prob                        0.1846677
##                                         Party.fctr.RFE.X..rcv.avNNet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                         0.8074771
## Party.fctr.All.X.ica.rcv.glmnet.prob                            0.3250021
##                                         Party.fctr.RFE.X..rcv.nnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                       0.7891566
## Party.fctr.All.X.ica.rcv.glmnet.prob                          0.3454953
##                                         Party.fctr.All.X..rcv.glm.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                      0.9255725
## Party.fctr.All.X.ica.rcv.glmnet.prob                         0.2840822
##                                         Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                               1.0000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.3169478
##                                         Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                               0.9528914
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.3166969
##                                         Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                        0.9633405
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.3611029
##                                         Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                            0.9667987
## Party.fctr.All.X.ica.rcv.glmnet.prob                               0.3553095
##                                         Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                    0.9638358
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.3316990
##                                         Party.fctr.RFE.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                              0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.3232876
##                                         Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                              0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.3232876
##                                         Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                         0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                            0.3232876
##                                         Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.9532567
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.2888450
##                                         Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   0.8952551
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.2233505
##                                         Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                            0.3169478
## Party.fctr.All.X.ica.rcv.glmnet.prob                               1.0000000
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob 
##                                        0.6622217 
##             Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                        0.6610541 
##          Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                                        0.6584739 
##             Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                        0.6584739 
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob 
##                                        0.6477674 
##           Party.fctr.RFE.X.range.rcv.glmnet.prob 
##                                        0.6439016 
##           Party.fctr.All.X.range.rcv.glmnet.prob 
##                                        0.6439016 
##                Party.fctr.All.X..rcv.glmnet.prob 
##                                        0.6439016 
##          Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                        0.6347942 
##       Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                        0.6210508 
##                   Party.fctr.All.X..rcv.glm.prob 
##                                        0.6048274 
##                  Party.fctr.RFE.X..rcv.nnet.prob 
##                                        0.5673259 
##                Party.fctr.RFE.X..rcv.avNNet.prob 
##                                        0.5662396 
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob 
##                                        0.5593028 
##                    Party.fctr.RFE.X..rcv.rf.prob 
##                                        0.3848337 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.3##rcv#glmnet"
## [1] "    indepVar: Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob"
## [1] "myfit_mdl: setup complete: 0.723000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.1, lambda = 0.212 on full training set
## [1] "myfit_mdl: train complete: 3.793000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: alpha
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0          100    -none-     numeric  
## beta        400    dgCMatrix  S4       
## df          100    -none-     numeric  
## dim           2    -none-     numeric  
## lambda      100    -none-     numeric  
## dev.ratio   100    -none-     numeric  
## nulldev       1    -none-     numeric  
## npasses       1    -none-     numeric  
## jerr          1    -none-     numeric  
## offset        1    -none-     logical  
## classnames    2    -none-     character
## call          5    -none-     call     
## nobs          1    -none-     numeric  
## lambdaOpt     1    -none-     numeric  
## xNames        4    -none-     character
## problemType   1    -none-     character
## tuneValue     2    data.frame list     
## obsLevels     2    -none-     character
## [1] "min lambda > lambdaOpt:"
##                             (Intercept) 
##                               -2.012030 
##           Party.fctr.RFE.X..rcv.rf.prob 
##                                3.057882 
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                                0.885104 
## [1] "max lambda < lambdaOpt:"
##                             (Intercept) 
##                              -2.1012213 
##           Party.fctr.RFE.X..rcv.rf.prob 
##                               3.2278729 
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                               0.8976997 
## [1] "myfit_mdl: train diagnostics complete: 4.658000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score accuracy
## 10      0.45       1        1
## 11      0.50       1        1

##          Prediction
## Reference    D    R
##         D 2360    0
##         R    0 2093
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      1.0000000      1.0000000      0.9991719      1.0000000      0.5299798 
## AccuracyPValue  McnemarPValue 
##      0.0000000            NaN

##          Prediction
## Reference   D   R
##         D 431 160
##         R 320 204
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   5.695067e-01   1.206740e-01   5.398436e-01   5.988021e-01   5.300448e-01 
## AccuracyPValue  McnemarPValue 
##   4.463755e-03   3.948235e-13 
## [1] "myfit_mdl: predict complete: 18.236000 secs"
##                            id
## 1 Ensemble.auto.3##rcv#glmnet
##                                                                                                               feats
## 1 Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      3.061                 0.086
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1               1            1            1               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5               1                1
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9991719                     1             1
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1       0.5510956    0.5888325    0.5133588        0.560904
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                   0.55       0.4594595        0.5695067
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5398436             0.5988021      0.120674
##   max.AccuracySD.fit max.KappaSD.fit
## 1                  0               0
## [1] "myfit_mdl: exit: 18.361000 secs"
## glmnet variable importance
## 
##                                         Overall
## Party.fctr.RFE.X..rcv.rf.prob            100.00
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob   28.02
## .rnorm                                     0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob       0.00
##                                         Party.fctr.RFE.X..rcv.rf.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                     0.5849997
## Party.fctr.All.X.ica.rcv.glmnet.prob                        0.1846677
## Party.fctr.RFE.X..rcv.rf.prob                               1.0000000
##                                         Party.fctr.RFE.X..rcv.avNNet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                         0.8074771
## Party.fctr.All.X.ica.rcv.glmnet.prob                            0.3250021
## Party.fctr.RFE.X..rcv.rf.prob                                   0.7359313
##                                         Party.fctr.RFE.X..rcv.nnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                       0.7891566
## Party.fctr.All.X.ica.rcv.glmnet.prob                          0.3454953
## Party.fctr.RFE.X..rcv.rf.prob                                 0.5627205
##                                         Party.fctr.All.X..rcv.glm.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                      0.9255725
## Party.fctr.All.X.ica.rcv.glmnet.prob                         0.2840822
## Party.fctr.RFE.X..rcv.rf.prob                                0.5767768
##                                         Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                               1.0000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.3169478
## Party.fctr.RFE.X..rcv.rf.prob                                         0.5849997
##                                         Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                               0.9528914
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.3166969
## Party.fctr.RFE.X..rcv.rf.prob                                         0.5625146
##                                         Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                        0.9633405
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.3611029
## Party.fctr.RFE.X..rcv.rf.prob                                                  0.5695557
##                                         Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                            0.9667987
## Party.fctr.All.X.ica.rcv.glmnet.prob                               0.3553095
## Party.fctr.RFE.X..rcv.rf.prob                                      0.5659386
##                                         Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                    0.9638358
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.3316990
## Party.fctr.RFE.X..rcv.rf.prob                                              0.5638367
##                                         Party.fctr.RFE.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                              0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                        0.5595358
##                                         Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                              0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                        0.5595358
##                                         Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                         0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                            0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                   0.5595358
##                                         Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.9532567
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.2888450
## Party.fctr.RFE.X..rcv.rf.prob                                            0.5523091
##                                         Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   0.8952551
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.2233505
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5177145
##                                         Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                            0.3169478
## Party.fctr.All.X.ica.rcv.glmnet.prob                               1.0000000
## Party.fctr.RFE.X..rcv.rf.prob                                      0.1846677
##          Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                                        0.6339825 
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob 
##                                        0.6313330 
##             Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                        0.6293490 
##                Party.fctr.RFE.X..rcv.avNNet.prob 
##                                        0.6228035 
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob 
##                                        0.6197905 
##           Party.fctr.RFE.X.range.rcv.glmnet.prob 
##                                        0.6157797 
##           Party.fctr.All.X.range.rcv.glmnet.prob 
##                                        0.6157797 
##                Party.fctr.All.X..rcv.glmnet.prob 
##                                        0.6157797 
##          Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                        0.6107010 
##       Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                        0.5981369 
##                   Party.fctr.All.X..rcv.glm.prob 
##                                        0.5954772 
##                    Party.fctr.RFE.X..rcv.rf.prob 
##                                        0.5898891 
##                  Party.fctr.RFE.X..rcv.nnet.prob 
##                                        0.5657908 
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob 
##                                        0.5454400 
##             Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                        0.5005385 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.4##rcv#glmnet"
## [1] "    indepVar: Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.723000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.325, lambda = 0.212 on full training set
## [1] "myfit_mdl: train complete: 3.563000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0          100    -none-     numeric  
## beta        500    dgCMatrix  S4       
## df          100    -none-     numeric  
## dim           2    -none-     numeric  
## lambda      100    -none-     numeric  
## dev.ratio   100    -none-     numeric  
## nulldev       1    -none-     numeric  
## npasses       1    -none-     numeric  
## jerr          1    -none-     numeric  
## offset        1    -none-     logical  
## classnames    2    -none-     character
## call          5    -none-     call     
## nobs          1    -none-     numeric  
## lambdaOpt     1    -none-     numeric  
## xNames        5    -none-     character
## problemType   1    -none-     character
## tuneValue     2    data.frame list     
## obsLevels     2    -none-     character
## [1] "min lambda > lambdaOpt:"
##                             (Intercept) 
##                              -1.7940650 
##           Party.fctr.RFE.X..rcv.rf.prob 
##                               3.3138947 
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                               0.1756913 
## [1] "max lambda < lambdaOpt:"
##                             (Intercept) 
##                              -1.8984063 
##           Party.fctr.RFE.X..rcv.rf.prob 
##                               3.5099540 
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                               0.1938878 
## [1] "myfit_mdl: train diagnostics complete: 4.201000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score accuracy
## 9       0.40       1        1
## 10      0.45       1        1
## 11      0.50       1        1
## 12      0.55       1        1

##          Prediction
## Reference    D    R
##         D 2360    0
##         R    0 2093
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      1.0000000      1.0000000      0.9991719      1.0000000      0.5299798 
## AccuracyPValue  McnemarPValue 
##      0.0000000            NaN

##          Prediction
## Reference   D   R
##         D 524  67
##         R 420 104
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   5.632287e-01   8.848497e-02   5.335330e-01   5.925900e-01   5.300448e-01 
## AccuracyPValue  McnemarPValue 
##   1.415177e-02   2.819807e-57 
## [1] "myfit_mdl: predict complete: 17.561000 secs"
##                            id
## 1 Ensemble.auto.4##rcv#glmnet
##                                                                                                                                                           feats
## 1 Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.831                 0.092
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1               1            1            1               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5               1                1
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9991719                     1             1
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1       0.5491679    0.6040609    0.4942748       0.5536838
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                    0.6       0.2992806        0.5632287
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1              0.533533               0.59259    0.08848497
##   max.AccuracySD.fit max.KappaSD.fit
## 1                  0               0
## [1] "myfit_mdl: exit: 17.687000 secs"
## glmnet variable importance
## 
##                                             Overall
## Party.fctr.RFE.X..rcv.rf.prob               100.000
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob       5.333
## .rnorm                                        0.000
## Party.fctr.All.X.ica.rcv.glmnet.prob          0.000
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob   0.000
##                                             Party.fctr.RFE.X..rcv.rf.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                         0.5849997
## Party.fctr.All.X.ica.rcv.glmnet.prob                            0.1846677
## Party.fctr.RFE.X..rcv.rf.prob                                   1.0000000
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                     0.5177145
##                                             Party.fctr.RFE.X..rcv.avNNet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                             0.8074771
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.3250021
## Party.fctr.RFE.X..rcv.rf.prob                                       0.7359313
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                         0.7207729
##                                             Party.fctr.RFE.X..rcv.nnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                           0.7891566
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.3454953
## Party.fctr.RFE.X..rcv.rf.prob                                     0.5627205
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                       0.6727984
##                                             Party.fctr.All.X..rcv.glm.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                          0.9255725
## Party.fctr.All.X.ica.rcv.glmnet.prob                             0.2840822
## Party.fctr.RFE.X..rcv.rf.prob                                    0.5767768
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                      0.8062761
##                                             Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   1.0000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.3169478
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5849997
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                               0.8952551
##                                             Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   0.9528914
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.3166969
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5625146
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                               0.8566523
##                                             Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                            0.9633405
## Party.fctr.All.X.ica.rcv.glmnet.prob                                               0.3611029
## Party.fctr.RFE.X..rcv.rf.prob                                                      0.5695557
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                        0.8894315
##                                             Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                0.9667987
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.3553095
## Party.fctr.RFE.X..rcv.rf.prob                                          0.5659386
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                            0.8949164
##                                             Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                        0.9638358
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.3316990
## Party.fctr.RFE.X..rcv.rf.prob                                                  0.5638367
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                    0.9109802
##                                             Party.fctr.RFE.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                            0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                              0.9122701
##                                             Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                            0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                              0.9122701
##                                             Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                             0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                       0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                         0.9122701
##                                             Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                      0.9532567
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2888450
## Party.fctr.RFE.X..rcv.rf.prob                                                0.5523091
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                  0.9683422
##                                             Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                       0.8952551
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2233505
## Party.fctr.RFE.X..rcv.rf.prob                                                 0.5177145
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                   1.0000000
##                                             Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                0.3169478
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.rf.prob                                          0.1846677
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                            0.2233505
##          Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                                        0.6993007 
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob 
##                                        0.6958577 
##             Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                        0.6957408 
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob 
##                                        0.6925879 
##       Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                        0.6906882 
##           Party.fctr.RFE.X.range.rcv.glmnet.prob 
##                                        0.6899023 
##           Party.fctr.All.X.range.rcv.glmnet.prob 
##                                        0.6899023 
##                Party.fctr.All.X..rcv.glmnet.prob 
##                                        0.6899023 
##          Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                        0.6721888 
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob 
##                                        0.6590800 
##                   Party.fctr.All.X..rcv.glm.prob 
##                                        0.6481769 
##                Party.fctr.RFE.X..rcv.avNNet.prob 
##                                        0.6472959 
##                  Party.fctr.RFE.X..rcv.nnet.prob 
##                                        0.5925427 
##                    Party.fctr.RFE.X..rcv.rf.prob 
##                                        0.5718455 
##             Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                        0.4312415 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.5##rcv#glmnet"
## [1] "    indepVar: Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob"
## [1] "myfit_mdl: setup complete: 0.721000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.325, lambda = 0.212 on full training set
## [1] "myfit_mdl: train complete: 4.043000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0          100    -none-     numeric  
## beta        600    dgCMatrix  S4       
## df          100    -none-     numeric  
## dim           2    -none-     numeric  
## lambda      100    -none-     numeric  
## dev.ratio   100    -none-     numeric  
## nulldev       1    -none-     numeric  
## npasses       1    -none-     numeric  
## jerr          1    -none-     numeric  
## offset        1    -none-     logical  
## classnames    2    -none-     character
## call          5    -none-     call     
## nobs          1    -none-     numeric  
## lambdaOpt     1    -none-     numeric  
## xNames        6    -none-     character
## problemType   1    -none-     character
## tuneValue     2    data.frame list     
## obsLevels     2    -none-     character
## [1] "min lambda > lambdaOpt:"
##                             (Intercept) 
##                             -1.86614523 
##         Party.fctr.RFE.X..rcv.nnet.prob 
##                              0.35845097 
##           Party.fctr.RFE.X..rcv.rf.prob 
##                              3.27130151 
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                              0.01194062 
## [1] "max lambda < lambdaOpt:"
##                             (Intercept) 
##                             -1.97295348 
##         Party.fctr.RFE.X..rcv.nnet.prob 
##                              0.38133148 
##           Party.fctr.RFE.X..rcv.rf.prob 
##                              3.46477987 
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                              0.01501864 
## [1] "myfit_mdl: train diagnostics complete: 4.682000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score accuracy
## 9       0.40       1        1
## 10      0.45       1        1
## 11      0.50       1        1
## 12      0.55       1        1

##          Prediction
## Reference    D    R
##         D 2360    0
##         R    0 2093
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      1.0000000      1.0000000      0.9991719      1.0000000      0.5299798 
## AccuracyPValue  McnemarPValue 
##      0.0000000            NaN

##          Prediction
## Reference   D   R
##         D 515  76
##         R 412 112
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   5.623318e-01   8.835632e-02   5.326318e-01   5.917021e-01   5.300448e-01 
## AccuracyPValue  McnemarPValue 
##   1.646917e-02   6.054050e-52 
## [1] "myfit_mdl: predict complete: 18.189000 secs"
##                            id
## 1 Ensemble.auto.5##rcv#glmnet
##                                                                                                                                                                                           feats
## 1 Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      3.313                   0.1
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1               1            1            1               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5               1                1
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9991719                     1             1
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1       0.5401861    0.5803723          0.5       0.5556826
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                    0.6       0.3146067        0.5623318
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5326318             0.5917021    0.08835632
##   max.AccuracySD.fit max.KappaSD.fit
## 1                  0               0
## [1] "myfit_mdl: exit: 18.380000 secs"
## glmnet variable importance
## 
##                                              Overall
## Party.fctr.RFE.X..rcv.rf.prob               100.0000
## Party.fctr.RFE.X..rcv.nnet.prob              10.9644
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob       0.3748
## .rnorm                                        0.0000
## Party.fctr.All.X.ica.rcv.glmnet.prob          0.0000
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob   0.0000
##                                             Party.fctr.RFE.X..rcv.rf.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                         0.5849997
## Party.fctr.All.X.ica.rcv.glmnet.prob                            0.1846677
## Party.fctr.RFE.X..rcv.rf.prob                                   1.0000000
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                     0.5177145
## Party.fctr.RFE.X..rcv.nnet.prob                                 0.5627205
##                                             Party.fctr.RFE.X..rcv.avNNet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                             0.8074771
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.3250021
## Party.fctr.RFE.X..rcv.rf.prob                                       0.7359313
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                         0.7207729
## Party.fctr.RFE.X..rcv.nnet.prob                                     0.8072394
##                                             Party.fctr.RFE.X..rcv.nnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                           0.7891566
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.3454953
## Party.fctr.RFE.X..rcv.rf.prob                                     0.5627205
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                       0.6727984
## Party.fctr.RFE.X..rcv.nnet.prob                                   1.0000000
##                                             Party.fctr.All.X..rcv.glm.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                          0.9255725
## Party.fctr.All.X.ica.rcv.glmnet.prob                             0.2840822
## Party.fctr.RFE.X..rcv.rf.prob                                    0.5767768
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                      0.8062761
## Party.fctr.RFE.X..rcv.nnet.prob                                  0.8296469
##                                             Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   1.0000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.3169478
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5849997
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                               0.8952551
## Party.fctr.RFE.X..rcv.nnet.prob                                           0.7891566
##                                             Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   0.9528914
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.3166969
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5625146
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                               0.8566523
## Party.fctr.RFE.X..rcv.nnet.prob                                           0.7759781
##                                             Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                            0.9633405
## Party.fctr.All.X.ica.rcv.glmnet.prob                                               0.3611029
## Party.fctr.RFE.X..rcv.rf.prob                                                      0.5695557
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                        0.8894315
## Party.fctr.RFE.X..rcv.nnet.prob                                                    0.7771171
##                                             Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                0.9667987
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.3553095
## Party.fctr.RFE.X..rcv.rf.prob                                          0.5659386
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                            0.8949164
## Party.fctr.RFE.X..rcv.nnet.prob                                        0.7687517
##                                             Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                        0.9638358
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.3316990
## Party.fctr.RFE.X..rcv.rf.prob                                                  0.5638367
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                    0.9109802
## Party.fctr.RFE.X..rcv.nnet.prob                                                0.7538010
##                                             Party.fctr.RFE.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                            0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                              0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                          0.7450408
##                                             Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                            0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                              0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                          0.7450408
##                                             Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                             0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                       0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                         0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                     0.7450408
##                                             Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                      0.9532567
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2888450
## Party.fctr.RFE.X..rcv.rf.prob                                                0.5523091
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                  0.9683422
## Party.fctr.RFE.X..rcv.nnet.prob                                              0.7286555
##                                             Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                       0.8952551
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2233505
## Party.fctr.RFE.X..rcv.rf.prob                                                 0.5177145
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.nnet.prob                                               0.6727984
##                                             Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                0.3169478
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.rf.prob                                          0.1846677
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                            0.2233505
## Party.fctr.RFE.X..rcv.nnet.prob                                        0.3454953
##          Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                                        0.7172719 
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob 
##                                        0.7121095 
##             Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                        0.7103430 
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob 
##                                        0.7048305 
##           Party.fctr.RFE.X.range.rcv.glmnet.prob 
##                                        0.7009300 
##           Party.fctr.All.X.range.rcv.glmnet.prob 
##                                        0.7009300 
##                Party.fctr.All.X..rcv.glmnet.prob 
##                                        0.7009300 
##       Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                        0.6982817 
##          Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                        0.6929467 
##                   Party.fctr.All.X..rcv.glm.prob 
##                                        0.6844709 
##                Party.fctr.RFE.X..rcv.avNNet.prob 
##                                        0.6792846 
##                  Party.fctr.RFE.X..rcv.nnet.prob 
##                                        0.6740342 
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob 
##                                        0.6618237 
##                    Party.fctr.RFE.X..rcv.rf.prob 
##                                        0.5700205 
##             Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                        0.4140923 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.6##rcv#glmnet"
## [1] "    indepVar: Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob"
## [1] "myfit_mdl: setup complete: 0.731000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.212 on full training set
## [1] "myfit_mdl: train complete: 3.712000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           96    -none-     numeric  
## beta        672    dgCMatrix  S4       
## df           96    -none-     numeric  
## dim           2    -none-     numeric  
## lambda       96    -none-     numeric  
## dev.ratio    96    -none-     numeric  
## nulldev       1    -none-     numeric  
## npasses       1    -none-     numeric  
## jerr          1    -none-     numeric  
## offset        1    -none-     logical  
## classnames    2    -none-     character
## call          5    -none-     call     
## nobs          1    -none-     numeric  
## lambdaOpt     1    -none-     numeric  
## xNames        7    -none-     character
## problemType   1    -none-     character
## tuneValue     2    data.frame list     
## obsLevels     2    -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.8570366                         0.4406734 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.1914988 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.9848102                         0.4918495 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.4039550 
## [1] "myfit_mdl: train diagnostics complete: 4.378000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score accuracy
## 9       0.40       1        1
## 10      0.45       1        1
## 11      0.50       1        1
## 12      0.55       1        1

##          Prediction
## Reference    D    R
##         D 2360    0
##         R    0 2093
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      1.0000000      1.0000000      0.9991719      1.0000000      0.5299798 
## AccuracyPValue  McnemarPValue 
##      0.0000000            NaN

##          Prediction
## Reference   D   R
##         D 512  79
##         R 405 119
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   5.659193e-01   9.684265e-02   5.362369e-01   5.952529e-01   5.300448e-01 
## AccuracyPValue  McnemarPValue 
##   8.804008e-03   2.196421e-49 
## [1] "myfit_mdl: predict complete: 18.352000 secs"
##                            id
## 1 Ensemble.auto.6##rcv#glmnet
##                                                                                                                                                                                                                             feats
## 1 Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.971                 0.102
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1               1            1            1               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5               1                1
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9991719                     1             1
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.552158    0.5871404    0.5171756       0.5560006
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                    0.6       0.3296399        0.5659193
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5362369             0.5952529    0.09684265
##   max.AccuracySD.fit max.KappaSD.fit
## 1                  0               0
## [1] "myfit_mdl: exit: 18.482000 secs"
## glmnet variable importance
## 
##                                             Overall
## Party.fctr.RFE.X..rcv.rf.prob                100.00
## Party.fctr.RFE.X..rcv.avNNet.prob             14.13
## .rnorm                                         0.00
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob        0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob           0.00
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob    0.00
## Party.fctr.RFE.X..rcv.nnet.prob                0.00
##                                             Party.fctr.RFE.X..rcv.rf.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                         0.5849997
## Party.fctr.All.X.ica.rcv.glmnet.prob                            0.1846677
## Party.fctr.RFE.X..rcv.rf.prob                                   1.0000000
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                     0.5177145
## Party.fctr.RFE.X..rcv.nnet.prob                                 0.5627205
## Party.fctr.RFE.X..rcv.avNNet.prob                               0.7359313
##                                             Party.fctr.RFE.X..rcv.avNNet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                             0.8074771
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.3250021
## Party.fctr.RFE.X..rcv.rf.prob                                       0.7359313
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                         0.7207729
## Party.fctr.RFE.X..rcv.nnet.prob                                     0.8072394
## Party.fctr.RFE.X..rcv.avNNet.prob                                   1.0000000
##                                             Party.fctr.RFE.X..rcv.nnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                           0.7891566
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.3454953
## Party.fctr.RFE.X..rcv.rf.prob                                     0.5627205
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                       0.6727984
## Party.fctr.RFE.X..rcv.nnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.avNNet.prob                                 0.8072394
##                                             Party.fctr.All.X..rcv.glm.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                          0.9255725
## Party.fctr.All.X.ica.rcv.glmnet.prob                             0.2840822
## Party.fctr.RFE.X..rcv.rf.prob                                    0.5767768
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                      0.8062761
## Party.fctr.RFE.X..rcv.nnet.prob                                  0.8296469
## Party.fctr.RFE.X..rcv.avNNet.prob                                0.8252145
##                                             Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   1.0000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.3169478
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5849997
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                               0.8952551
## Party.fctr.RFE.X..rcv.nnet.prob                                           0.7891566
## Party.fctr.RFE.X..rcv.avNNet.prob                                         0.8074771
##                                             Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   0.9528914
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.3166969
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5625146
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                               0.8566523
## Party.fctr.RFE.X..rcv.nnet.prob                                           0.7759781
## Party.fctr.RFE.X..rcv.avNNet.prob                                         0.8074028
##                                             Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                            0.9633405
## Party.fctr.All.X.ica.rcv.glmnet.prob                                               0.3611029
## Party.fctr.RFE.X..rcv.rf.prob                                                      0.5695557
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                        0.8894315
## Party.fctr.RFE.X..rcv.nnet.prob                                                    0.7771171
## Party.fctr.RFE.X..rcv.avNNet.prob                                                  0.8101480
##                                             Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                0.9667987
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.3553095
## Party.fctr.RFE.X..rcv.rf.prob                                          0.5659386
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                            0.8949164
## Party.fctr.RFE.X..rcv.nnet.prob                                        0.7687517
## Party.fctr.RFE.X..rcv.avNNet.prob                                      0.7956346
##                                             Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                        0.9638358
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.3316990
## Party.fctr.RFE.X..rcv.rf.prob                                                  0.5638367
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                    0.9109802
## Party.fctr.RFE.X..rcv.nnet.prob                                                0.7538010
## Party.fctr.RFE.X..rcv.avNNet.prob                                              0.7745838
##                                             Party.fctr.RFE.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                            0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                              0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                          0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                        0.7621485
##                                             Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                            0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                              0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                          0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                        0.7621485
##                                             Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                             0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                       0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                         0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                     0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                   0.7621485
##                                             Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                      0.9532567
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2888450
## Party.fctr.RFE.X..rcv.rf.prob                                                0.5523091
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                  0.9683422
## Party.fctr.RFE.X..rcv.nnet.prob                                              0.7286555
## Party.fctr.RFE.X..rcv.avNNet.prob                                            0.7599499
##                                             Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                       0.8952551
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2233505
## Party.fctr.RFE.X..rcv.rf.prob                                                 0.5177145
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.nnet.prob                                               0.6727984
## Party.fctr.RFE.X..rcv.avNNet.prob                                             0.7207729
##                                             Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                0.3169478
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.rf.prob                                          0.1846677
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                            0.2233505
## Party.fctr.RFE.X..rcv.nnet.prob                                        0.3454953
## Party.fctr.RFE.X..rcv.avNNet.prob                                      0.3250021
##                Party.fctr.RFE.X..rcv.avNNet.prob 
##                                        0.7327371 
##          Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                                        0.7323061 
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob 
##                                        0.7284493 
##             Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                        0.7245583 
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob 
##                                        0.7164561 
##          Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                        0.7120227 
##           Party.fctr.RFE.X.range.rcv.glmnet.prob 
##                                        0.7111331 
##           Party.fctr.All.X.range.rcv.glmnet.prob 
##                                        0.7111331 
##                Party.fctr.All.X..rcv.glmnet.prob 
##                                        0.7111331 
##       Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                        0.7085597 
##                   Party.fctr.All.X..rcv.glm.prob 
##                                        0.7079282 
##                  Party.fctr.RFE.X..rcv.nnet.prob 
##                                        0.6962350 
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob 
##                                        0.6716486 
##                    Party.fctr.RFE.X..rcv.rf.prob 
##                                        0.5976723 
##             Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                        0.3992439 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.7##rcv#glmnet"
## [1] "    indepVar: Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob"
## [1] "myfit_mdl: setup complete: 0.727000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.212 on full training set
## [1] "myfit_mdl: train complete: 3.883000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           96    -none-     numeric  
## beta        768    dgCMatrix  S4       
## df           96    -none-     numeric  
## dim           2    -none-     numeric  
## lambda       96    -none-     numeric  
## dev.ratio    96    -none-     numeric  
## nulldev       1    -none-     numeric  
## npasses       1    -none-     numeric  
## jerr          1    -none-     numeric  
## offset        1    -none-     logical  
## classnames    2    -none-     character
## call          5    -none-     call     
## nobs          1    -none-     numeric  
## lambdaOpt     1    -none-     numeric  
## xNames        8    -none-     character
## problemType   1    -none-     character
## tuneValue     2    data.frame list     
## obsLevels     2    -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.8570366                         0.4406734 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.1914988 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.9848102                         0.4918495 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.4039550 
## [1] "myfit_mdl: train diagnostics complete: 4.675000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score accuracy
## 9       0.40       1        1
## 10      0.45       1        1
## 11      0.50       1        1
## 12      0.55       1        1

##          Prediction
## Reference    D    R
##         D 2360    0
##         R    0 2093
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      1.0000000      1.0000000      0.9991719      1.0000000      0.5299798 
## AccuracyPValue  McnemarPValue 
##      0.0000000            NaN

##          Prediction
## Reference   D   R
##         D 512  79
##         R 405 119
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   5.659193e-01   9.684265e-02   5.362369e-01   5.952529e-01   5.300448e-01 
## AccuracyPValue  McnemarPValue 
##   8.804008e-03   2.196421e-49 
## [1] "myfit_mdl: predict complete: 18.379000 secs"
##                            id
## 1 Ensemble.auto.7##rcv#glmnet
##                                                                                                                                                                                                                                                            feats
## 1 Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      3.146                 0.104
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1               1            1            1               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5               1                1
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9991719                     1             1
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.552158    0.5871404    0.5171756       0.5560006
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                    0.6       0.3296399        0.5659193
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5362369             0.5952529    0.09684265
##   max.AccuracySD.fit max.KappaSD.fit
## 1                  0               0
## [1] "myfit_mdl: exit: 18.798000 secs"
## glmnet variable importance
## 
##                                             Overall
## Party.fctr.RFE.X..rcv.rf.prob                100.00
## Party.fctr.RFE.X..rcv.avNNet.prob             14.13
## .rnorm                                         0.00
## Party.fctr.RFE.X..rcv.nnet.prob                0.00
## Party.fctr.All.X..rcv.glm.prob                 0.00
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob        0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob           0.00
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob    0.00
##                                             Party.fctr.RFE.X..rcv.rf.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                         0.5849997
## Party.fctr.All.X.ica.rcv.glmnet.prob                            0.1846677
## Party.fctr.RFE.X..rcv.rf.prob                                   1.0000000
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                     0.5177145
## Party.fctr.RFE.X..rcv.nnet.prob                                 0.5627205
## Party.fctr.RFE.X..rcv.avNNet.prob                               0.7359313
## Party.fctr.All.X..rcv.glm.prob                                  0.5767768
##                                             Party.fctr.RFE.X..rcv.avNNet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                             0.8074771
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.3250021
## Party.fctr.RFE.X..rcv.rf.prob                                       0.7359313
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                         0.7207729
## Party.fctr.RFE.X..rcv.nnet.prob                                     0.8072394
## Party.fctr.RFE.X..rcv.avNNet.prob                                   1.0000000
## Party.fctr.All.X..rcv.glm.prob                                      0.8252145
##                                             Party.fctr.RFE.X..rcv.nnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                           0.7891566
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.3454953
## Party.fctr.RFE.X..rcv.rf.prob                                     0.5627205
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                       0.6727984
## Party.fctr.RFE.X..rcv.nnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.avNNet.prob                                 0.8072394
## Party.fctr.All.X..rcv.glm.prob                                    0.8296469
##                                             Party.fctr.All.X..rcv.glm.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                          0.9255725
## Party.fctr.All.X.ica.rcv.glmnet.prob                             0.2840822
## Party.fctr.RFE.X..rcv.rf.prob                                    0.5767768
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                      0.8062761
## Party.fctr.RFE.X..rcv.nnet.prob                                  0.8296469
## Party.fctr.RFE.X..rcv.avNNet.prob                                0.8252145
## Party.fctr.All.X..rcv.glm.prob                                   1.0000000
##                                             Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   1.0000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.3169478
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5849997
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                               0.8952551
## Party.fctr.RFE.X..rcv.nnet.prob                                           0.7891566
## Party.fctr.RFE.X..rcv.avNNet.prob                                         0.8074771
## Party.fctr.All.X..rcv.glm.prob                                            0.9255725
##                                             Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   0.9528914
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.3166969
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5625146
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                               0.8566523
## Party.fctr.RFE.X..rcv.nnet.prob                                           0.7759781
## Party.fctr.RFE.X..rcv.avNNet.prob                                         0.8074028
## Party.fctr.All.X..rcv.glm.prob                                            0.9205344
##                                             Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                            0.9633405
## Party.fctr.All.X.ica.rcv.glmnet.prob                                               0.3611029
## Party.fctr.RFE.X..rcv.rf.prob                                                      0.5695557
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                        0.8894315
## Party.fctr.RFE.X..rcv.nnet.prob                                                    0.7771171
## Party.fctr.RFE.X..rcv.avNNet.prob                                                  0.8101480
## Party.fctr.All.X..rcv.glm.prob                                                     0.9014065
##                                             Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                0.9667987
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.3553095
## Party.fctr.RFE.X..rcv.rf.prob                                          0.5659386
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                            0.8949164
## Party.fctr.RFE.X..rcv.nnet.prob                                        0.7687517
## Party.fctr.RFE.X..rcv.avNNet.prob                                      0.7956346
## Party.fctr.All.X..rcv.glm.prob                                         0.9001967
##                                             Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                        0.9638358
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.3316990
## Party.fctr.RFE.X..rcv.rf.prob                                                  0.5638367
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                    0.9109802
## Party.fctr.RFE.X..rcv.nnet.prob                                                0.7538010
## Party.fctr.RFE.X..rcv.avNNet.prob                                              0.7745838
## Party.fctr.All.X..rcv.glm.prob                                                 0.8769625
##                                             Party.fctr.RFE.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                            0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                              0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                          0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                        0.7621485
## Party.fctr.All.X..rcv.glm.prob                                           0.8740747
##                                             Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                            0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                              0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                          0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                        0.7621485
## Party.fctr.All.X..rcv.glm.prob                                           0.8740747
##                                             Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                             0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                       0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                         0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                     0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                   0.7621485
## Party.fctr.All.X..rcv.glm.prob                                      0.8740747
##                                             Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                      0.9532567
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2888450
## Party.fctr.RFE.X..rcv.rf.prob                                                0.5523091
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                  0.9683422
## Party.fctr.RFE.X..rcv.nnet.prob                                              0.7286555
## Party.fctr.RFE.X..rcv.avNNet.prob                                            0.7599499
## Party.fctr.All.X..rcv.glm.prob                                               0.8611484
##                                             Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                       0.8952551
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2233505
## Party.fctr.RFE.X..rcv.rf.prob                                                 0.5177145
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.nnet.prob                                               0.6727984
## Party.fctr.RFE.X..rcv.avNNet.prob                                             0.7207729
## Party.fctr.All.X..rcv.glm.prob                                                0.8062761
##                                             Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                0.3169478
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.rf.prob                                          0.1846677
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                            0.2233505
## Party.fctr.RFE.X..rcv.nnet.prob                                        0.3454953
## Party.fctr.RFE.X..rcv.avNNet.prob                                      0.3250021
## Party.fctr.All.X..rcv.glm.prob                                         0.2840822
##          Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                                        0.7599155 
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob 
##                                        0.7531575 
##                   Party.fctr.All.X..rcv.glm.prob 
##                                        0.7496527 
##             Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                        0.7496495 
##                Party.fctr.RFE.X..rcv.avNNet.prob 
##                                        0.7459482 
##          Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                        0.7418101 
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob 
##                                        0.7393855 
##           Party.fctr.RFE.X.range.rcv.glmnet.prob 
##                                        0.7344104 
##           Party.fctr.All.X.range.rcv.glmnet.prob 
##                                        0.7344104 
##                Party.fctr.All.X..rcv.glmnet.prob 
##                                        0.7344104 
##       Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                        0.7303581 
##                  Party.fctr.RFE.X..rcv.nnet.prob 
##                                        0.7152939 
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob 
##                                        0.6908811 
##                    Party.fctr.RFE.X..rcv.rf.prob 
##                                        0.5946872 
##             Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                        0.3827922 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.8##rcv#glmnet"
## [1] "    indepVar: Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.724000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.212 on full training set
## [1] "myfit_mdl: train complete: 3.831000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           96    -none-     numeric  
## beta        864    dgCMatrix  S4       
## df           96    -none-     numeric  
## dim           2    -none-     numeric  
## lambda       96    -none-     numeric  
## dev.ratio    96    -none-     numeric  
## nulldev       1    -none-     numeric  
## npasses       1    -none-     numeric  
## jerr          1    -none-     numeric  
## offset        1    -none-     logical  
## classnames    2    -none-     character
## call          5    -none-     call     
## nobs          1    -none-     numeric  
## lambdaOpt     1    -none-     numeric  
## xNames        9    -none-     character
## problemType   1    -none-     character
## tuneValue     2    data.frame list     
## obsLevels     2    -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.8570366                         0.4406734 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.1914988 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.9848102                         0.4918495 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.4039550 
## [1] "myfit_mdl: train diagnostics complete: 4.487000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score accuracy
## 9       0.40       1        1
## 10      0.45       1        1
## 11      0.50       1        1
## 12      0.55       1        1

##          Prediction
## Reference    D    R
##         D 2360    0
##         R    0 2093
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      1.0000000      1.0000000      0.9991719      1.0000000      0.5299798 
## AccuracyPValue  McnemarPValue 
##      0.0000000            NaN

##          Prediction
## Reference   D   R
##         D 512  79
##         R 405 119
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   5.659193e-01   9.684265e-02   5.362369e-01   5.952529e-01   5.300448e-01 
## AccuracyPValue  McnemarPValue 
##   8.804008e-03   2.196421e-49 
## [1] "myfit_mdl: predict complete: 17.814000 secs"
##                            id
## 1 Ensemble.auto.8##rcv#glmnet
##                                                                                                                                                                                                                                                                                                       feats
## 1 Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      3.096                 0.109
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1               1            1            1               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5               1                1
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9991719                     1             1
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.552158    0.5871404    0.5171756       0.5560006
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                    0.6       0.3296399        0.5659193
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5362369             0.5952529    0.09684265
##   max.AccuracySD.fit max.KappaSD.fit
## 1                  0               0
## [1] "myfit_mdl: exit: 17.949000 secs"
## glmnet variable importance
## 
##                                             Overall
## Party.fctr.RFE.X..rcv.rf.prob                100.00
## Party.fctr.RFE.X..rcv.avNNet.prob             14.13
## .rnorm                                         0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob           0.00
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob    0.00
## Party.fctr.All.X..rcv.glm.prob                 0.00
## Party.fctr.RFE.X..rcv.nnet.prob                0.00
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob     0.00
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob        0.00
##                                             Party.fctr.RFE.X..rcv.rf.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                         0.5849997
## Party.fctr.All.X.ica.rcv.glmnet.prob                            0.1846677
## Party.fctr.RFE.X..rcv.rf.prob                                   1.0000000
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                     0.5177145
## Party.fctr.RFE.X..rcv.nnet.prob                                 0.5627205
## Party.fctr.RFE.X..rcv.avNNet.prob                               0.7359313
## Party.fctr.All.X..rcv.glm.prob                                  0.5767768
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                      0.5523091
##                                             Party.fctr.RFE.X..rcv.avNNet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                             0.8074771
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.3250021
## Party.fctr.RFE.X..rcv.rf.prob                                       0.7359313
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                         0.7207729
## Party.fctr.RFE.X..rcv.nnet.prob                                     0.8072394
## Party.fctr.RFE.X..rcv.avNNet.prob                                   1.0000000
## Party.fctr.All.X..rcv.glm.prob                                      0.8252145
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                          0.7599499
##                                             Party.fctr.RFE.X..rcv.nnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                           0.7891566
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.3454953
## Party.fctr.RFE.X..rcv.rf.prob                                     0.5627205
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                       0.6727984
## Party.fctr.RFE.X..rcv.nnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.avNNet.prob                                 0.8072394
## Party.fctr.All.X..rcv.glm.prob                                    0.8296469
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                        0.7286555
##                                             Party.fctr.All.X..rcv.glm.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                          0.9255725
## Party.fctr.All.X.ica.rcv.glmnet.prob                             0.2840822
## Party.fctr.RFE.X..rcv.rf.prob                                    0.5767768
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                      0.8062761
## Party.fctr.RFE.X..rcv.nnet.prob                                  0.8296469
## Party.fctr.RFE.X..rcv.avNNet.prob                                0.8252145
## Party.fctr.All.X..rcv.glm.prob                                   1.0000000
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                       0.8611484
##                                             Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   1.0000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.3169478
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5849997
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                               0.8952551
## Party.fctr.RFE.X..rcv.nnet.prob                                           0.7891566
## Party.fctr.RFE.X..rcv.avNNet.prob                                         0.8074771
## Party.fctr.All.X..rcv.glm.prob                                            0.9255725
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.9532567
##                                             Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   0.9528914
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.3166969
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5625146
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                               0.8566523
## Party.fctr.RFE.X..rcv.nnet.prob                                           0.7759781
## Party.fctr.RFE.X..rcv.avNNet.prob                                         0.8074028
## Party.fctr.All.X..rcv.glm.prob                                            0.9205344
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.9169026
##                                             Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                            0.9633405
## Party.fctr.All.X.ica.rcv.glmnet.prob                                               0.3611029
## Party.fctr.RFE.X..rcv.rf.prob                                                      0.5695557
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                        0.8894315
## Party.fctr.RFE.X..rcv.nnet.prob                                                    0.7771171
## Party.fctr.RFE.X..rcv.avNNet.prob                                                  0.8101480
## Party.fctr.All.X..rcv.glm.prob                                                     0.9014065
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                         0.9577354
##                                             Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                0.9667987
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.3553095
## Party.fctr.RFE.X..rcv.rf.prob                                          0.5659386
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                            0.8949164
## Party.fctr.RFE.X..rcv.nnet.prob                                        0.7687517
## Party.fctr.RFE.X..rcv.avNNet.prob                                      0.7956346
## Party.fctr.All.X..rcv.glm.prob                                         0.9001967
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                             0.9636515
##                                             Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                        0.9638358
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.3316990
## Party.fctr.RFE.X..rcv.rf.prob                                                  0.5638367
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                    0.9109802
## Party.fctr.RFE.X..rcv.nnet.prob                                                0.7538010
## Party.fctr.RFE.X..rcv.avNNet.prob                                              0.7745838
## Party.fctr.All.X..rcv.glm.prob                                                 0.8769625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                     0.9817237
##                                             Party.fctr.RFE.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                            0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                              0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                          0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                        0.7621485
## Party.fctr.All.X..rcv.glm.prob                                           0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                               0.9839495
##                                             Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                            0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                              0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                          0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                        0.7621485
## Party.fctr.All.X..rcv.glm.prob                                           0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                               0.9839495
##                                             Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                             0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                       0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                         0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                     0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                   0.7621485
## Party.fctr.All.X..rcv.glm.prob                                      0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                          0.9839495
##                                             Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                      0.9532567
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2888450
## Party.fctr.RFE.X..rcv.rf.prob                                                0.5523091
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                  0.9683422
## Party.fctr.RFE.X..rcv.nnet.prob                                              0.7286555
## Party.fctr.RFE.X..rcv.avNNet.prob                                            0.7599499
## Party.fctr.All.X..rcv.glm.prob                                               0.8611484
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   1.0000000
##                                             Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                       0.8952551
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2233505
## Party.fctr.RFE.X..rcv.rf.prob                                                 0.5177145
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.nnet.prob                                               0.6727984
## Party.fctr.RFE.X..rcv.avNNet.prob                                             0.7207729
## Party.fctr.All.X..rcv.glm.prob                                                0.8062761
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.9683422
##                                             Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                0.3169478
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.rf.prob                                          0.1846677
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                            0.2233505
## Party.fctr.RFE.X..rcv.nnet.prob                                        0.3454953
## Party.fctr.RFE.X..rcv.avNNet.prob                                      0.3250021
## Party.fctr.All.X..rcv.glm.prob                                         0.2840822
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                             0.2888450
##          Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                                        0.7840832 
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob 
##                                        0.7787297 
##             Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                        0.7763997 
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob 
##                                        0.7696778 
##           Party.fctr.RFE.X.range.rcv.glmnet.prob 
##                                        0.7656028 
##           Party.fctr.All.X.range.rcv.glmnet.prob 
##                                        0.7656028 
##                Party.fctr.All.X..rcv.glmnet.prob 
##                                        0.7656028 
##       Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                        0.7640634 
##          Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                        0.7636967 
##                   Party.fctr.All.X..rcv.glm.prob 
##                                        0.7635897 
##                Party.fctr.RFE.X..rcv.avNNet.prob 
##                                        0.7476984 
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob 
##                                        0.7255637 
##                  Party.fctr.RFE.X..rcv.nnet.prob 
##                                        0.7169641 
##                    Party.fctr.RFE.X..rcv.rf.prob 
##                                        0.5893900 
##             Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                        0.3710488 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.9##rcv#glmnet"
## [1] "    indepVar: Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.700000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.212 on full training set
## [1] "myfit_mdl: train complete: 3.930000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0           96    -none-     numeric  
## beta        960    dgCMatrix  S4       
## df           96    -none-     numeric  
## dim           2    -none-     numeric  
## lambda       96    -none-     numeric  
## dev.ratio    96    -none-     numeric  
## nulldev       1    -none-     numeric  
## npasses       1    -none-     numeric  
## jerr          1    -none-     numeric  
## offset        1    -none-     logical  
## classnames    2    -none-     character
## call          5    -none-     call     
## nobs          1    -none-     numeric  
## lambdaOpt     1    -none-     numeric  
## xNames       10    -none-     character
## problemType   1    -none-     character
## tuneValue     2    data.frame list     
## obsLevels     2    -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.8570366                         0.4406734 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.1914988 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.9848102                         0.4918495 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.4039550 
## [1] "myfit_mdl: train diagnostics complete: 4.593000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score accuracy
## 9       0.40       1        1
## 10      0.45       1        1
## 11      0.50       1        1
## 12      0.55       1        1

##          Prediction
## Reference    D    R
##         D 2360    0
##         R    0 2093
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      1.0000000      1.0000000      0.9991719      1.0000000      0.5299798 
## AccuracyPValue  McnemarPValue 
##      0.0000000            NaN

##          Prediction
## Reference   D   R
##         D 512  79
##         R 405 119
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   5.659193e-01   9.684265e-02   5.362369e-01   5.952529e-01   5.300448e-01 
## AccuracyPValue  McnemarPValue 
##   8.804008e-03   2.196421e-49 
## [1] "myfit_mdl: predict complete: 18.049000 secs"
##                            id
## 1 Ensemble.auto.9##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                               feats
## 1 Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      3.219                 0.108
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1               1            1            1               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5               1                1
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9991719                     1             1
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.552158    0.5871404    0.5171756       0.5560006
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                    0.6       0.3296399        0.5659193
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5362369             0.5952529    0.09684265
##   max.AccuracySD.fit max.KappaSD.fit
## 1                  0               0
## [1] "myfit_mdl: exit: 18.179000 secs"
## glmnet variable importance
## 
##                                             Overall
## Party.fctr.RFE.X..rcv.rf.prob                100.00
## Party.fctr.RFE.X..rcv.avNNet.prob             14.13
## .rnorm                                         0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob           0.00
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob    0.00
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob        0.00
## Party.fctr.All.X..rcv.glm.prob                 0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob        0.00
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob     0.00
## Party.fctr.RFE.X..rcv.nnet.prob                0.00
##                                             Party.fctr.RFE.X..rcv.rf.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                         0.5849997
## Party.fctr.All.X.ica.rcv.glmnet.prob                            0.1846677
## Party.fctr.RFE.X..rcv.rf.prob                                   1.0000000
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                     0.5177145
## Party.fctr.RFE.X..rcv.nnet.prob                                 0.5627205
## Party.fctr.RFE.X..rcv.avNNet.prob                               0.7359313
## Party.fctr.All.X..rcv.glm.prob                                  0.5767768
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                      0.5523091
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                         0.5625146
##                                             Party.fctr.RFE.X..rcv.avNNet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                             0.8074771
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.3250021
## Party.fctr.RFE.X..rcv.rf.prob                                       0.7359313
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                         0.7207729
## Party.fctr.RFE.X..rcv.nnet.prob                                     0.8072394
## Party.fctr.RFE.X..rcv.avNNet.prob                                   1.0000000
## Party.fctr.All.X..rcv.glm.prob                                      0.8252145
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                          0.7599499
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                             0.8074028
##                                             Party.fctr.RFE.X..rcv.nnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                           0.7891566
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.3454953
## Party.fctr.RFE.X..rcv.rf.prob                                     0.5627205
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                       0.6727984
## Party.fctr.RFE.X..rcv.nnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.avNNet.prob                                 0.8072394
## Party.fctr.All.X..rcv.glm.prob                                    0.8296469
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                        0.7286555
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.7759781
##                                             Party.fctr.All.X..rcv.glm.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                          0.9255725
## Party.fctr.All.X.ica.rcv.glmnet.prob                             0.2840822
## Party.fctr.RFE.X..rcv.rf.prob                                    0.5767768
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                      0.8062761
## Party.fctr.RFE.X..rcv.nnet.prob                                  0.8296469
## Party.fctr.RFE.X..rcv.avNNet.prob                                0.8252145
## Party.fctr.All.X..rcv.glm.prob                                   1.0000000
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                       0.8611484
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                          0.9205344
##                                             Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   1.0000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.3169478
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5849997
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                               0.8952551
## Party.fctr.RFE.X..rcv.nnet.prob                                           0.7891566
## Party.fctr.RFE.X..rcv.avNNet.prob                                         0.8074771
## Party.fctr.All.X..rcv.glm.prob                                            0.9255725
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.9532567
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.9528914
##                                             Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   0.9528914
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.3166969
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5625146
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                               0.8566523
## Party.fctr.RFE.X..rcv.nnet.prob                                           0.7759781
## Party.fctr.RFE.X..rcv.avNNet.prob                                         0.8074028
## Party.fctr.All.X..rcv.glm.prob                                            0.9205344
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.9169026
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   1.0000000
##                                             Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                            0.9633405
## Party.fctr.All.X.ica.rcv.glmnet.prob                                               0.3611029
## Party.fctr.RFE.X..rcv.rf.prob                                                      0.5695557
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                        0.8894315
## Party.fctr.RFE.X..rcv.nnet.prob                                                    0.7771171
## Party.fctr.RFE.X..rcv.avNNet.prob                                                  0.8101480
## Party.fctr.All.X..rcv.glm.prob                                                     0.9014065
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                         0.9577354
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                            0.9580909
##                                             Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                0.9667987
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.3553095
## Party.fctr.RFE.X..rcv.rf.prob                                          0.5659386
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                            0.8949164
## Party.fctr.RFE.X..rcv.nnet.prob                                        0.7687517
## Party.fctr.RFE.X..rcv.avNNet.prob                                      0.7956346
## Party.fctr.All.X..rcv.glm.prob                                         0.9001967
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                             0.9636515
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.9574912
##                                             Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                        0.9638358
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.3316990
## Party.fctr.RFE.X..rcv.rf.prob                                                  0.5638367
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                    0.9109802
## Party.fctr.RFE.X..rcv.nnet.prob                                                0.7538010
## Party.fctr.RFE.X..rcv.avNNet.prob                                              0.7745838
## Party.fctr.All.X..rcv.glm.prob                                                 0.8769625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                     0.9817237
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.9295067
##                                             Party.fctr.RFE.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                            0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                              0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                          0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                        0.7621485
## Party.fctr.All.X..rcv.glm.prob                                           0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                               0.9839495
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.9274426
##                                             Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                            0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                              0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                          0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                        0.7621485
## Party.fctr.All.X..rcv.glm.prob                                           0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                               0.9839495
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.9274426
##                                             Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                             0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                       0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                         0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                     0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                   0.7621485
## Party.fctr.All.X..rcv.glm.prob                                      0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                          0.9839495
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                             0.9274426
##                                             Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                      0.9532567
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2888450
## Party.fctr.RFE.X..rcv.rf.prob                                                0.5523091
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                  0.9683422
## Party.fctr.RFE.X..rcv.nnet.prob                                              0.7286555
## Party.fctr.RFE.X..rcv.avNNet.prob                                            0.7599499
## Party.fctr.All.X..rcv.glm.prob                                               0.8611484
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.9169026
##                                             Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                       0.8952551
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2233505
## Party.fctr.RFE.X..rcv.rf.prob                                                 0.5177145
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.nnet.prob                                               0.6727984
## Party.fctr.RFE.X..rcv.avNNet.prob                                             0.7207729
## Party.fctr.All.X..rcv.glm.prob                                                0.8062761
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.9683422
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.8566523
##                                             Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                0.3169478
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.rf.prob                                          0.1846677
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                            0.2233505
## Party.fctr.RFE.X..rcv.nnet.prob                                        0.3454953
## Party.fctr.RFE.X..rcv.avNNet.prob                                      0.3250021
## Party.fctr.All.X..rcv.glm.prob                                         0.2840822
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                             0.2888450
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.3166969
##          Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                                        0.8028397 
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob 
##                                        0.7986587 
##             Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                        0.7965210 
##          Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                        0.7899526 
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob 
##                                        0.7874366 
##           Party.fctr.RFE.X.range.rcv.glmnet.prob 
##                                        0.7835850 
##           Party.fctr.All.X.range.rcv.glmnet.prob 
##                                        0.7835850 
##                Party.fctr.All.X..rcv.glmnet.prob 
##                                        0.7835850 
##       Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                        0.7810455 
##                   Party.fctr.All.X..rcv.glm.prob 
##                                        0.7810280 
##                Party.fctr.RFE.X..rcv.avNNet.prob 
##                                        0.7543322 
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob 
##                                        0.7401291 
##                  Party.fctr.RFE.X..rcv.nnet.prob 
##                                        0.7235212 
##                    Party.fctr.RFE.X..rcv.rf.prob 
##                                        0.5864038 
##             Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                        0.3650097 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.10##rcv#glmnet"
## [1] "    indepVar: Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.702000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.212 on full training set
## [1] "myfit_mdl: train complete: 4.391000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0            96   -none-     numeric  
## beta        1056   dgCMatrix  S4       
## df            96   -none-     numeric  
## dim            2   -none-     numeric  
## lambda        96   -none-     numeric  
## dev.ratio     96   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        11   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.8570366                         0.4406734 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.1914988 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.9848102                         0.4918495 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.4039550 
## [1] "myfit_mdl: train diagnostics complete: 5.046000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score accuracy
## 9       0.40       1        1
## 10      0.45       1        1
## 11      0.50       1        1
## 12      0.55       1        1

##          Prediction
## Reference    D    R
##         D 2360    0
##         R    0 2093
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      1.0000000      1.0000000      0.9991719      1.0000000      0.5299798 
## AccuracyPValue  McnemarPValue 
##      0.0000000            NaN

##          Prediction
## Reference   D   R
##         D 512  79
##         R 405 119
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   5.659193e-01   9.684265e-02   5.362369e-01   5.952529e-01   5.300448e-01 
## AccuracyPValue  McnemarPValue 
##   8.804008e-03   2.196421e-49 
## [1] "myfit_mdl: predict complete: 18.450000 secs"
##                             id
## 1 Ensemble.auto.10##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                 feats
## 1 Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      3.676                 0.112
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1               1            1            1               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5               1                1
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9991719                     1             1
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.552158    0.5871404    0.5171756       0.5560006
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                    0.6       0.3296399        0.5659193
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5362369             0.5952529    0.09684265
##   max.AccuracySD.fit max.KappaSD.fit
## 1                  0               0
## [1] "myfit_mdl: exit: 18.596000 secs"
## glmnet variable importance
## 
##                                             Overall
## Party.fctr.RFE.X..rcv.rf.prob                100.00
## Party.fctr.RFE.X..rcv.avNNet.prob             14.13
## .rnorm                                         0.00
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob     0.00
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob        0.00
## Party.fctr.RFE.X..rcv.nnet.prob                0.00
## Party.fctr.All.X..rcv.glm.prob                 0.00
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob    0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob           0.00
## Party.fctr.All.X..rcv.glmnet.prob              0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob        0.00
##                                             Party.fctr.RFE.X..rcv.rf.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                         0.5849997
## Party.fctr.All.X.ica.rcv.glmnet.prob                            0.1846677
## Party.fctr.RFE.X..rcv.rf.prob                                   1.0000000
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                     0.5177145
## Party.fctr.RFE.X..rcv.nnet.prob                                 0.5627205
## Party.fctr.RFE.X..rcv.avNNet.prob                               0.7359313
## Party.fctr.All.X..rcv.glm.prob                                  0.5767768
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                      0.5523091
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                         0.5625146
## Party.fctr.All.X..rcv.glmnet.prob                               0.5595358
##                                             Party.fctr.RFE.X..rcv.avNNet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                             0.8074771
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.3250021
## Party.fctr.RFE.X..rcv.rf.prob                                       0.7359313
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                         0.7207729
## Party.fctr.RFE.X..rcv.nnet.prob                                     0.8072394
## Party.fctr.RFE.X..rcv.avNNet.prob                                   1.0000000
## Party.fctr.All.X..rcv.glm.prob                                      0.8252145
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                          0.7599499
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                             0.8074028
## Party.fctr.All.X..rcv.glmnet.prob                                   0.7621485
##                                             Party.fctr.RFE.X..rcv.nnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                           0.7891566
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.3454953
## Party.fctr.RFE.X..rcv.rf.prob                                     0.5627205
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                       0.6727984
## Party.fctr.RFE.X..rcv.nnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.avNNet.prob                                 0.8072394
## Party.fctr.All.X..rcv.glm.prob                                    0.8296469
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                        0.7286555
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.7759781
## Party.fctr.All.X..rcv.glmnet.prob                                 0.7450408
##                                             Party.fctr.All.X..rcv.glm.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                          0.9255725
## Party.fctr.All.X.ica.rcv.glmnet.prob                             0.2840822
## Party.fctr.RFE.X..rcv.rf.prob                                    0.5767768
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                      0.8062761
## Party.fctr.RFE.X..rcv.nnet.prob                                  0.8296469
## Party.fctr.RFE.X..rcv.avNNet.prob                                0.8252145
## Party.fctr.All.X..rcv.glm.prob                                   1.0000000
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                       0.8611484
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                          0.9205344
## Party.fctr.All.X..rcv.glmnet.prob                                0.8740747
##                                             Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   1.0000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.3169478
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5849997
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                               0.8952551
## Party.fctr.RFE.X..rcv.nnet.prob                                           0.7891566
## Party.fctr.RFE.X..rcv.avNNet.prob                                         0.8074771
## Party.fctr.All.X..rcv.glm.prob                                            0.9255725
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.9532567
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.9528914
## Party.fctr.All.X..rcv.glmnet.prob                                         0.9645156
##                                             Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   0.9528914
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.3166969
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5625146
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                               0.8566523
## Party.fctr.RFE.X..rcv.nnet.prob                                           0.7759781
## Party.fctr.RFE.X..rcv.avNNet.prob                                         0.8074028
## Party.fctr.All.X..rcv.glm.prob                                            0.9205344
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.9169026
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X..rcv.glmnet.prob                                         0.9274426
##                                             Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                            0.9633405
## Party.fctr.All.X.ica.rcv.glmnet.prob                                               0.3611029
## Party.fctr.RFE.X..rcv.rf.prob                                                      0.5695557
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                        0.8894315
## Party.fctr.RFE.X..rcv.nnet.prob                                                    0.7771171
## Party.fctr.RFE.X..rcv.avNNet.prob                                                  0.8101480
## Party.fctr.All.X..rcv.glm.prob                                                     0.9014065
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                         0.9577354
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                            0.9580909
## Party.fctr.All.X..rcv.glmnet.prob                                                  0.9721249
##                                             Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                0.9667987
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.3553095
## Party.fctr.RFE.X..rcv.rf.prob                                          0.5659386
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                            0.8949164
## Party.fctr.RFE.X..rcv.nnet.prob                                        0.7687517
## Party.fctr.RFE.X..rcv.avNNet.prob                                      0.7956346
## Party.fctr.All.X..rcv.glm.prob                                         0.9001967
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                             0.9636515
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.9574912
## Party.fctr.All.X..rcv.glmnet.prob                                      0.9781410
##                                             Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                        0.9638358
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.3316990
## Party.fctr.RFE.X..rcv.rf.prob                                                  0.5638367
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                    0.9109802
## Party.fctr.RFE.X..rcv.nnet.prob                                                0.7538010
## Party.fctr.RFE.X..rcv.avNNet.prob                                              0.7745838
## Party.fctr.All.X..rcv.glm.prob                                                 0.8769625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                     0.9817237
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.9295067
## Party.fctr.All.X..rcv.glmnet.prob                                              0.9970833
##                                             Party.fctr.RFE.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                            0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                              0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                          0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                        0.7621485
## Party.fctr.All.X..rcv.glm.prob                                           0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                               0.9839495
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.9274426
## Party.fctr.All.X..rcv.glmnet.prob                                        1.0000000
##                                             Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                            0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                              0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                          0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                        0.7621485
## Party.fctr.All.X..rcv.glm.prob                                           0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                               0.9839495
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.9274426
## Party.fctr.All.X..rcv.glmnet.prob                                        1.0000000
##                                             Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                             0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                       0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                         0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                     0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                   0.7621485
## Party.fctr.All.X..rcv.glm.prob                                      0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                          0.9839495
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                             0.9274426
## Party.fctr.All.X..rcv.glmnet.prob                                   1.0000000
##                                             Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                      0.9532567
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2888450
## Party.fctr.RFE.X..rcv.rf.prob                                                0.5523091
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                  0.9683422
## Party.fctr.RFE.X..rcv.nnet.prob                                              0.7286555
## Party.fctr.RFE.X..rcv.avNNet.prob                                            0.7599499
## Party.fctr.All.X..rcv.glm.prob                                               0.8611484
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.9169026
## Party.fctr.All.X..rcv.glmnet.prob                                            0.9839495
##                                             Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                       0.8952551
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2233505
## Party.fctr.RFE.X..rcv.rf.prob                                                 0.5177145
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.nnet.prob                                               0.6727984
## Party.fctr.RFE.X..rcv.avNNet.prob                                             0.7207729
## Party.fctr.All.X..rcv.glm.prob                                                0.8062761
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.9683422
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.8566523
## Party.fctr.All.X..rcv.glmnet.prob                                             0.9122701
##                                             Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                0.3169478
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.rf.prob                                          0.1846677
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                            0.2233505
## Party.fctr.RFE.X..rcv.nnet.prob                                        0.3454953
## Party.fctr.RFE.X..rcv.avNNet.prob                                      0.3250021
## Party.fctr.All.X..rcv.glm.prob                                         0.2840822
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                             0.2888450
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.3166969
## Party.fctr.All.X..rcv.glmnet.prob                                      0.3232876
##          Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                                        0.8190072 
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob 
##                                        0.8160053 
##             Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                        0.8146830 
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob 
##                                        0.8084013 
##           Party.fctr.RFE.X.range.rcv.glmnet.prob 
##                                        0.8052265 
##           Party.fctr.All.X.range.rcv.glmnet.prob 
##                                        0.8052265 
##                Party.fctr.All.X..rcv.glmnet.prob 
##                                        0.8052265 
##          Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                        0.8037016 
##       Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                        0.8013359 
##                   Party.fctr.All.X..rcv.glm.prob 
##                                        0.7903327 
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob 
##                                        0.7573432 
##                Party.fctr.RFE.X..rcv.avNNet.prob 
##                                        0.7551139 
##                  Party.fctr.RFE.X..rcv.nnet.prob 
##                                        0.7256732 
##                    Party.fctr.RFE.X..rcv.rf.prob 
##                                        0.5837170 
##             Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                        0.3608375 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.11##rcv#glmnet"
## [1] "    indepVar: Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.718000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.212 on full training set
## [1] "myfit_mdl: train complete: 4.186000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0            96   -none-     numeric  
## beta        1152   dgCMatrix  S4       
## df            96   -none-     numeric  
## dim            2   -none-     numeric  
## lambda        96   -none-     numeric  
## dev.ratio     96   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        12   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.8570366                         0.4406734 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.1914988 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.9848102                         0.4918495 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.4039550 
## [1] "myfit_mdl: train diagnostics complete: 4.873000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score accuracy
## 9       0.40       1        1
## 10      0.45       1        1
## 11      0.50       1        1
## 12      0.55       1        1

##          Prediction
## Reference    D    R
##         D 2360    0
##         R    0 2093
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      1.0000000      1.0000000      0.9991719      1.0000000      0.5299798 
## AccuracyPValue  McnemarPValue 
##      0.0000000            NaN

##          Prediction
## Reference   D   R
##         D 512  79
##         R 405 119
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   5.659193e-01   9.684265e-02   5.362369e-01   5.952529e-01   5.300448e-01 
## AccuracyPValue  McnemarPValue 
##   8.804008e-03   2.196421e-49 
## [1] "myfit_mdl: predict complete: 18.577000 secs"
##                             id
## 1 Ensemble.auto.11##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                        feats
## 1 Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      3.455                 0.119
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1               1            1            1               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5               1                1
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9991719                     1             1
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.552158    0.5871404    0.5171756       0.5560006
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                    0.6       0.3296399        0.5659193
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5362369             0.5952529    0.09684265
##   max.AccuracySD.fit max.KappaSD.fit
## 1                  0               0
## [1] "myfit_mdl: exit: 18.711000 secs"
## glmnet variable importance
## 
##                                             Overall
## Party.fctr.RFE.X..rcv.rf.prob                100.00
## Party.fctr.RFE.X..rcv.avNNet.prob             14.13
## .rnorm                                         0.00
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob     0.00
## Party.fctr.RFE.X..rcv.nnet.prob                0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob        0.00
## Party.fctr.All.X..rcv.glm.prob                 0.00
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob        0.00
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob    0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob           0.00
## Party.fctr.All.X..rcv.glmnet.prob              0.00
## Party.fctr.All.X.range.rcv.glmnet.prob         0.00
##                                             Party.fctr.RFE.X..rcv.rf.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                         0.5849997
## Party.fctr.All.X.ica.rcv.glmnet.prob                            0.1846677
## Party.fctr.RFE.X..rcv.rf.prob                                   1.0000000
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                     0.5177145
## Party.fctr.RFE.X..rcv.nnet.prob                                 0.5627205
## Party.fctr.RFE.X..rcv.avNNet.prob                               0.7359313
## Party.fctr.All.X..rcv.glm.prob                                  0.5767768
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                      0.5523091
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                         0.5625146
## Party.fctr.All.X..rcv.glmnet.prob                               0.5595358
## Party.fctr.All.X.range.rcv.glmnet.prob                          0.5595358
##                                             Party.fctr.RFE.X..rcv.avNNet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                             0.8074771
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.3250021
## Party.fctr.RFE.X..rcv.rf.prob                                       0.7359313
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                         0.7207729
## Party.fctr.RFE.X..rcv.nnet.prob                                     0.8072394
## Party.fctr.RFE.X..rcv.avNNet.prob                                   1.0000000
## Party.fctr.All.X..rcv.glm.prob                                      0.8252145
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                          0.7599499
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                             0.8074028
## Party.fctr.All.X..rcv.glmnet.prob                                   0.7621485
## Party.fctr.All.X.range.rcv.glmnet.prob                              0.7621485
##                                             Party.fctr.RFE.X..rcv.nnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                           0.7891566
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.3454953
## Party.fctr.RFE.X..rcv.rf.prob                                     0.5627205
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                       0.6727984
## Party.fctr.RFE.X..rcv.nnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.avNNet.prob                                 0.8072394
## Party.fctr.All.X..rcv.glm.prob                                    0.8296469
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                        0.7286555
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.7759781
## Party.fctr.All.X..rcv.glmnet.prob                                 0.7450408
## Party.fctr.All.X.range.rcv.glmnet.prob                            0.7450408
##                                             Party.fctr.All.X..rcv.glm.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                          0.9255725
## Party.fctr.All.X.ica.rcv.glmnet.prob                             0.2840822
## Party.fctr.RFE.X..rcv.rf.prob                                    0.5767768
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                      0.8062761
## Party.fctr.RFE.X..rcv.nnet.prob                                  0.8296469
## Party.fctr.RFE.X..rcv.avNNet.prob                                0.8252145
## Party.fctr.All.X..rcv.glm.prob                                   1.0000000
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                       0.8611484
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                          0.9205344
## Party.fctr.All.X..rcv.glmnet.prob                                0.8740747
## Party.fctr.All.X.range.rcv.glmnet.prob                           0.8740747
##                                             Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   1.0000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.3169478
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5849997
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                               0.8952551
## Party.fctr.RFE.X..rcv.nnet.prob                                           0.7891566
## Party.fctr.RFE.X..rcv.avNNet.prob                                         0.8074771
## Party.fctr.All.X..rcv.glm.prob                                            0.9255725
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.9532567
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.9528914
## Party.fctr.All.X..rcv.glmnet.prob                                         0.9645156
## Party.fctr.All.X.range.rcv.glmnet.prob                                    0.9645156
##                                             Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   0.9528914
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.3166969
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5625146
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                               0.8566523
## Party.fctr.RFE.X..rcv.nnet.prob                                           0.7759781
## Party.fctr.RFE.X..rcv.avNNet.prob                                         0.8074028
## Party.fctr.All.X..rcv.glm.prob                                            0.9205344
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.9169026
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X..rcv.glmnet.prob                                         0.9274426
## Party.fctr.All.X.range.rcv.glmnet.prob                                    0.9274426
##                                             Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                            0.9633405
## Party.fctr.All.X.ica.rcv.glmnet.prob                                               0.3611029
## Party.fctr.RFE.X..rcv.rf.prob                                                      0.5695557
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                        0.8894315
## Party.fctr.RFE.X..rcv.nnet.prob                                                    0.7771171
## Party.fctr.RFE.X..rcv.avNNet.prob                                                  0.8101480
## Party.fctr.All.X..rcv.glm.prob                                                     0.9014065
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                         0.9577354
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                            0.9580909
## Party.fctr.All.X..rcv.glmnet.prob                                                  0.9721249
## Party.fctr.All.X.range.rcv.glmnet.prob                                             0.9721249
##                                             Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                0.9667987
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.3553095
## Party.fctr.RFE.X..rcv.rf.prob                                          0.5659386
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                            0.8949164
## Party.fctr.RFE.X..rcv.nnet.prob                                        0.7687517
## Party.fctr.RFE.X..rcv.avNNet.prob                                      0.7956346
## Party.fctr.All.X..rcv.glm.prob                                         0.9001967
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                             0.9636515
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.9574912
## Party.fctr.All.X..rcv.glmnet.prob                                      0.9781410
## Party.fctr.All.X.range.rcv.glmnet.prob                                 0.9781410
##                                             Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                        0.9638358
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.3316990
## Party.fctr.RFE.X..rcv.rf.prob                                                  0.5638367
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                    0.9109802
## Party.fctr.RFE.X..rcv.nnet.prob                                                0.7538010
## Party.fctr.RFE.X..rcv.avNNet.prob                                              0.7745838
## Party.fctr.All.X..rcv.glm.prob                                                 0.8769625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                     0.9817237
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.9295067
## Party.fctr.All.X..rcv.glmnet.prob                                              0.9970833
## Party.fctr.All.X.range.rcv.glmnet.prob                                         0.9970833
##                                             Party.fctr.RFE.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                            0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                              0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                          0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                        0.7621485
## Party.fctr.All.X..rcv.glm.prob                                           0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                               0.9839495
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.9274426
## Party.fctr.All.X..rcv.glmnet.prob                                        1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                                   1.0000000
##                                             Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                            0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                              0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                          0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                        0.7621485
## Party.fctr.All.X..rcv.glm.prob                                           0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                               0.9839495
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.9274426
## Party.fctr.All.X..rcv.glmnet.prob                                        1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                                   1.0000000
##                                             Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                             0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                       0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                         0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                     0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                   0.7621485
## Party.fctr.All.X..rcv.glm.prob                                      0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                          0.9839495
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                             0.9274426
## Party.fctr.All.X..rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                              1.0000000
##                                             Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                      0.9532567
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2888450
## Party.fctr.RFE.X..rcv.rf.prob                                                0.5523091
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                  0.9683422
## Party.fctr.RFE.X..rcv.nnet.prob                                              0.7286555
## Party.fctr.RFE.X..rcv.avNNet.prob                                            0.7599499
## Party.fctr.All.X..rcv.glm.prob                                               0.8611484
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.9169026
## Party.fctr.All.X..rcv.glmnet.prob                                            0.9839495
## Party.fctr.All.X.range.rcv.glmnet.prob                                       0.9839495
##                                             Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                       0.8952551
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2233505
## Party.fctr.RFE.X..rcv.rf.prob                                                 0.5177145
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.nnet.prob                                               0.6727984
## Party.fctr.RFE.X..rcv.avNNet.prob                                             0.7207729
## Party.fctr.All.X..rcv.glm.prob                                                0.8062761
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.9683422
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.8566523
## Party.fctr.All.X..rcv.glmnet.prob                                             0.9122701
## Party.fctr.All.X.range.rcv.glmnet.prob                                        0.9122701
##                                             Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                0.3169478
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.rf.prob                                          0.1846677
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                            0.2233505
## Party.fctr.RFE.X..rcv.nnet.prob                                        0.3454953
## Party.fctr.RFE.X..rcv.avNNet.prob                                      0.3250021
## Party.fctr.All.X..rcv.glm.prob                                         0.2840822
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                             0.2888450
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.3166969
## Party.fctr.All.X..rcv.glmnet.prob                                      0.3232876
## Party.fctr.All.X.range.rcv.glmnet.prob                                 0.3232876
##          Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                                        0.8322353 
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob 
##                                        0.8301980 
##             Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                        0.8295428 
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob 
##                                        0.8255542 
##           Party.fctr.RFE.X.range.rcv.glmnet.prob 
##                                        0.8229332 
##           Party.fctr.All.X.range.rcv.glmnet.prob 
##                                        0.8229332 
##                Party.fctr.All.X..rcv.glmnet.prob 
##                                        0.8229332 
##       Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                        0.8179371 
##          Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                        0.8149508 
##                   Party.fctr.All.X..rcv.glm.prob 
##                                        0.7979456 
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob 
##                                        0.7714275 
##                Party.fctr.RFE.X..rcv.avNNet.prob 
##                                        0.7557534 
##                  Party.fctr.RFE.X..rcv.nnet.prob 
##                                        0.7274339 
##                    Party.fctr.RFE.X..rcv.rf.prob 
##                                        0.5815187 
##             Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                        0.3574239 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.12##rcv#glmnet"
## [1] "    indepVar: Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.range.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.698000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.212 on full training set
## [1] "myfit_mdl: train complete: 4.183000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0            96   -none-     numeric  
## beta        1248   dgCMatrix  S4       
## df            96   -none-     numeric  
## dim            2   -none-     numeric  
## lambda        96   -none-     numeric  
## dev.ratio     96   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        13   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.8570366                         0.4406734 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.1914988 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.9848102                         0.4918495 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.4039550 
## [1] "myfit_mdl: train diagnostics complete: 4.840000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score accuracy
## 9       0.40       1        1
## 10      0.45       1        1
## 11      0.50       1        1
## 12      0.55       1        1

##          Prediction
## Reference    D    R
##         D 2360    0
##         R    0 2093
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      1.0000000      1.0000000      0.9991719      1.0000000      0.5299798 
## AccuracyPValue  McnemarPValue 
##      0.0000000            NaN

##          Prediction
## Reference   D   R
##         D 512  79
##         R 405 119
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   5.659193e-01   9.684265e-02   5.362369e-01   5.952529e-01   5.300448e-01 
## AccuracyPValue  McnemarPValue 
##   8.804008e-03   2.196421e-49 
## [1] "myfit_mdl: predict complete: 18.339000 secs"
##                             id
## 1 Ensemble.auto.12##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                               feats
## 1 Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.range.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      3.472                 0.125
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1               1            1            1               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5               1                1
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9991719                     1             1
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.552158    0.5871404    0.5171756       0.5560006
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                    0.6       0.3296399        0.5659193
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5362369             0.5952529    0.09684265
##   max.AccuracySD.fit max.KappaSD.fit
## 1                  0               0
## [1] "myfit_mdl: exit: 19.034000 secs"
## glmnet variable importance
## 
##                                             Overall
## Party.fctr.RFE.X..rcv.rf.prob                100.00
## Party.fctr.RFE.X..rcv.avNNet.prob             14.13
## .rnorm                                         0.00
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob     0.00
## Party.fctr.RFE.X..rcv.nnet.prob                0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob        0.00
## Party.fctr.RFE.X.range.rcv.glmnet.prob         0.00
## Party.fctr.All.X..rcv.glm.prob                 0.00
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob        0.00
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob    0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob           0.00
## Party.fctr.All.X..rcv.glmnet.prob              0.00
## Party.fctr.All.X.range.rcv.glmnet.prob         0.00
##                                             Party.fctr.RFE.X..rcv.rf.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                         0.5849997
## Party.fctr.All.X.ica.rcv.glmnet.prob                            0.1846677
## Party.fctr.RFE.X..rcv.rf.prob                                   1.0000000
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                     0.5177145
## Party.fctr.RFE.X..rcv.nnet.prob                                 0.5627205
## Party.fctr.RFE.X..rcv.avNNet.prob                               0.7359313
## Party.fctr.All.X..rcv.glm.prob                                  0.5767768
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                      0.5523091
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                         0.5625146
## Party.fctr.All.X..rcv.glmnet.prob                               0.5595358
## Party.fctr.All.X.range.rcv.glmnet.prob                          0.5595358
## Party.fctr.RFE.X.range.rcv.glmnet.prob                          0.5595358
##                                             Party.fctr.RFE.X..rcv.avNNet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                             0.8074771
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.3250021
## Party.fctr.RFE.X..rcv.rf.prob                                       0.7359313
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                         0.7207729
## Party.fctr.RFE.X..rcv.nnet.prob                                     0.8072394
## Party.fctr.RFE.X..rcv.avNNet.prob                                   1.0000000
## Party.fctr.All.X..rcv.glm.prob                                      0.8252145
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                          0.7599499
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                             0.8074028
## Party.fctr.All.X..rcv.glmnet.prob                                   0.7621485
## Party.fctr.All.X.range.rcv.glmnet.prob                              0.7621485
## Party.fctr.RFE.X.range.rcv.glmnet.prob                              0.7621485
##                                             Party.fctr.RFE.X..rcv.nnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                           0.7891566
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.3454953
## Party.fctr.RFE.X..rcv.rf.prob                                     0.5627205
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                       0.6727984
## Party.fctr.RFE.X..rcv.nnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.avNNet.prob                                 0.8072394
## Party.fctr.All.X..rcv.glm.prob                                    0.8296469
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                        0.7286555
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.7759781
## Party.fctr.All.X..rcv.glmnet.prob                                 0.7450408
## Party.fctr.All.X.range.rcv.glmnet.prob                            0.7450408
## Party.fctr.RFE.X.range.rcv.glmnet.prob                            0.7450408
##                                             Party.fctr.All.X..rcv.glm.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                          0.9255725
## Party.fctr.All.X.ica.rcv.glmnet.prob                             0.2840822
## Party.fctr.RFE.X..rcv.rf.prob                                    0.5767768
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                      0.8062761
## Party.fctr.RFE.X..rcv.nnet.prob                                  0.8296469
## Party.fctr.RFE.X..rcv.avNNet.prob                                0.8252145
## Party.fctr.All.X..rcv.glm.prob                                   1.0000000
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                       0.8611484
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                          0.9205344
## Party.fctr.All.X..rcv.glmnet.prob                                0.8740747
## Party.fctr.All.X.range.rcv.glmnet.prob                           0.8740747
## Party.fctr.RFE.X.range.rcv.glmnet.prob                           0.8740747
##                                             Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   1.0000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.3169478
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5849997
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                               0.8952551
## Party.fctr.RFE.X..rcv.nnet.prob                                           0.7891566
## Party.fctr.RFE.X..rcv.avNNet.prob                                         0.8074771
## Party.fctr.All.X..rcv.glm.prob                                            0.9255725
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.9532567
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.9528914
## Party.fctr.All.X..rcv.glmnet.prob                                         0.9645156
## Party.fctr.All.X.range.rcv.glmnet.prob                                    0.9645156
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                    0.9645156
##                                             Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   0.9528914
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.3166969
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5625146
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                               0.8566523
## Party.fctr.RFE.X..rcv.nnet.prob                                           0.7759781
## Party.fctr.RFE.X..rcv.avNNet.prob                                         0.8074028
## Party.fctr.All.X..rcv.glm.prob                                            0.9205344
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.9169026
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X..rcv.glmnet.prob                                         0.9274426
## Party.fctr.All.X.range.rcv.glmnet.prob                                    0.9274426
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                    0.9274426
##                                             Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                            0.9633405
## Party.fctr.All.X.ica.rcv.glmnet.prob                                               0.3611029
## Party.fctr.RFE.X..rcv.rf.prob                                                      0.5695557
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                        0.8894315
## Party.fctr.RFE.X..rcv.nnet.prob                                                    0.7771171
## Party.fctr.RFE.X..rcv.avNNet.prob                                                  0.8101480
## Party.fctr.All.X..rcv.glm.prob                                                     0.9014065
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                         0.9577354
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                            0.9580909
## Party.fctr.All.X..rcv.glmnet.prob                                                  0.9721249
## Party.fctr.All.X.range.rcv.glmnet.prob                                             0.9721249
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                             0.9721249
##                                             Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                0.9667987
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.3553095
## Party.fctr.RFE.X..rcv.rf.prob                                          0.5659386
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                            0.8949164
## Party.fctr.RFE.X..rcv.nnet.prob                                        0.7687517
## Party.fctr.RFE.X..rcv.avNNet.prob                                      0.7956346
## Party.fctr.All.X..rcv.glm.prob                                         0.9001967
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                             0.9636515
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.9574912
## Party.fctr.All.X..rcv.glmnet.prob                                      0.9781410
## Party.fctr.All.X.range.rcv.glmnet.prob                                 0.9781410
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                 0.9781410
##                                             Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                        0.9638358
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.3316990
## Party.fctr.RFE.X..rcv.rf.prob                                                  0.5638367
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                    0.9109802
## Party.fctr.RFE.X..rcv.nnet.prob                                                0.7538010
## Party.fctr.RFE.X..rcv.avNNet.prob                                              0.7745838
## Party.fctr.All.X..rcv.glm.prob                                                 0.8769625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                     0.9817237
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.9295067
## Party.fctr.All.X..rcv.glmnet.prob                                              0.9970833
## Party.fctr.All.X.range.rcv.glmnet.prob                                         0.9970833
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                         0.9970833
##                                             Party.fctr.RFE.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                            0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                              0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                          0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                        0.7621485
## Party.fctr.All.X..rcv.glm.prob                                           0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                               0.9839495
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.9274426
## Party.fctr.All.X..rcv.glmnet.prob                                        1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                                   1.0000000
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                   1.0000000
##                                             Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                            0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                              0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                          0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                        0.7621485
## Party.fctr.All.X..rcv.glm.prob                                           0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                               0.9839495
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.9274426
## Party.fctr.All.X..rcv.glmnet.prob                                        1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                                   1.0000000
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                   1.0000000
##                                             Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                             0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                       0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                         0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                     0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                   0.7621485
## Party.fctr.All.X..rcv.glm.prob                                      0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                          0.9839495
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                             0.9274426
## Party.fctr.All.X..rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                              1.0000000
## Party.fctr.RFE.X.range.rcv.glmnet.prob                              1.0000000
##                                             Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                      0.9532567
## Party.fctr.All.X.ica.rcv.glmnet.prob                                         0.2888450
## Party.fctr.RFE.X..rcv.rf.prob                                                0.5523091
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                  0.9683422
## Party.fctr.RFE.X..rcv.nnet.prob                                              0.7286555
## Party.fctr.RFE.X..rcv.avNNet.prob                                            0.7599499
## Party.fctr.All.X..rcv.glm.prob                                               0.8611484
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                   1.0000000
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                      0.9169026
## Party.fctr.All.X..rcv.glmnet.prob                                            0.9839495
## Party.fctr.All.X.range.rcv.glmnet.prob                                       0.9839495
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                       0.9839495
##                                             Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                       0.8952551
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2233505
## Party.fctr.RFE.X..rcv.rf.prob                                                 0.5177145
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.nnet.prob                                               0.6727984
## Party.fctr.RFE.X..rcv.avNNet.prob                                             0.7207729
## Party.fctr.All.X..rcv.glm.prob                                                0.8062761
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.9683422
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.8566523
## Party.fctr.All.X..rcv.glmnet.prob                                             0.9122701
## Party.fctr.All.X.range.rcv.glmnet.prob                                        0.9122701
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                        0.9122701
##                                             Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                0.3169478
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   1.0000000
## Party.fctr.RFE.X..rcv.rf.prob                                          0.1846677
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                            0.2233505
## Party.fctr.RFE.X..rcv.nnet.prob                                        0.3454953
## Party.fctr.RFE.X..rcv.avNNet.prob                                      0.3250021
## Party.fctr.All.X..rcv.glm.prob                                         0.2840822
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                             0.2888450
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.3166969
## Party.fctr.All.X..rcv.glmnet.prob                                      0.3232876
## Party.fctr.All.X.range.rcv.glmnet.prob                                 0.3232876
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                 0.3232876
##          Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                                        0.8432586 
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob 
##                                        0.8420253 
##             Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                        0.8419260 
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob 
##                                        0.8398483 
##           Party.fctr.RFE.X.range.rcv.glmnet.prob 
##                                        0.8376888 
##           Party.fctr.All.X.range.rcv.glmnet.prob 
##                                        0.8376888 
##                Party.fctr.All.X..rcv.glmnet.prob 
##                                        0.8376888 
##       Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                        0.8317715 
##          Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                        0.8243251 
##                   Party.fctr.All.X..rcv.glm.prob 
##                                        0.8042897 
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob 
##                                        0.7831644 
##                Party.fctr.RFE.X..rcv.avNNet.prob 
##                                        0.7562863 
##                  Party.fctr.RFE.X..rcv.nnet.prob 
##                                        0.7289011 
##                    Party.fctr.RFE.X..rcv.rf.prob 
##                                        0.5796868 
##             Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                        0.3545792 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.13##rcv#glmnet"
## [1] "    indepVar: Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.770000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.212 on full training set
## [1] "myfit_mdl: train complete: 4.481000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0            96   -none-     numeric  
## beta        1344   dgCMatrix  S4       
## df            96   -none-     numeric  
## dim            2   -none-     numeric  
## lambda        96   -none-     numeric  
## dev.ratio     96   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        14   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.8570366                         0.4406734 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.1914988 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.9848102                         0.4918495 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.4039550 
## [1] "myfit_mdl: train diagnostics complete: 5.130000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score accuracy
## 9       0.40       1        1
## 10      0.45       1        1
## 11      0.50       1        1
## 12      0.55       1        1

##          Prediction
## Reference    D    R
##         D 2360    0
##         R    0 2093
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      1.0000000      1.0000000      0.9991719      1.0000000      0.5299798 
## AccuracyPValue  McnemarPValue 
##      0.0000000            NaN

##          Prediction
## Reference   D   R
##         D 512  79
##         R 405 119
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   5.659193e-01   9.684265e-02   5.362369e-01   5.952529e-01   5.300448e-01 
## AccuracyPValue  McnemarPValue 
##   8.804008e-03   2.196421e-49 
## [1] "myfit_mdl: predict complete: 18.977000 secs"
##                             id
## 1 Ensemble.auto.13##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            feats
## 1 Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      3.698                 0.131
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1               1            1            1               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5               1                1
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9991719                     1             1
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.552158    0.5871404    0.5171756       0.5560006
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                    0.6       0.3296399        0.5659193
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5362369             0.5952529    0.09684265
##   max.AccuracySD.fit max.KappaSD.fit
## 1                  0               0
## [1] "myfit_mdl: exit: 19.119000 secs"
## glmnet variable importance
## 
##                                              Overall
## Party.fctr.RFE.X..rcv.rf.prob                 100.00
## Party.fctr.RFE.X..rcv.avNNet.prob              14.13
## .rnorm                                          0.00
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob      0.00
## Party.fctr.RFE.X..rcv.nnet.prob                 0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob         0.00
## Party.fctr.RFE.X.range.rcv.glmnet.prob          0.00
## Party.fctr.All.X..rcv.glm.prob                  0.00
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob         0.00
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob     0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob            0.00
## Party.fctr.All.X..rcv.glmnet.prob               0.00
## Party.fctr.All.X.range.rcv.glmnet.prob          0.00
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob    0.00
##                                              Party.fctr.RFE.X..rcv.rf.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                          0.5849997
## Party.fctr.All.X.ica.rcv.glmnet.prob                             0.1846677
## Party.fctr.RFE.X..rcv.rf.prob                                    1.0000000
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                      0.5177145
## Party.fctr.RFE.X..rcv.nnet.prob                                  0.5627205
## Party.fctr.RFE.X..rcv.avNNet.prob                                0.7359313
## Party.fctr.All.X..rcv.glm.prob                                   0.5767768
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                       0.5523091
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                          0.5625146
## Party.fctr.All.X..rcv.glmnet.prob                                0.5595358
## Party.fctr.All.X.range.rcv.glmnet.prob                           0.5595358
## Party.fctr.RFE.X.range.rcv.glmnet.prob                           0.5595358
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                     0.5638367
##                                              Party.fctr.RFE.X..rcv.avNNet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                              0.8074771
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.3250021
## Party.fctr.RFE.X..rcv.rf.prob                                        0.7359313
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                          0.7207729
## Party.fctr.RFE.X..rcv.nnet.prob                                      0.8072394
## Party.fctr.RFE.X..rcv.avNNet.prob                                    1.0000000
## Party.fctr.All.X..rcv.glm.prob                                       0.8252145
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                           0.7599499
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.8074028
## Party.fctr.All.X..rcv.glmnet.prob                                    0.7621485
## Party.fctr.All.X.range.rcv.glmnet.prob                               0.7621485
## Party.fctr.RFE.X.range.rcv.glmnet.prob                               0.7621485
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                         0.7745838
##                                              Party.fctr.RFE.X..rcv.nnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                            0.7891566
## Party.fctr.All.X.ica.rcv.glmnet.prob                               0.3454953
## Party.fctr.RFE.X..rcv.rf.prob                                      0.5627205
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                        0.6727984
## Party.fctr.RFE.X..rcv.nnet.prob                                    1.0000000
## Party.fctr.RFE.X..rcv.avNNet.prob                                  0.8072394
## Party.fctr.All.X..rcv.glm.prob                                     0.8296469
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                         0.7286555
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                            0.7759781
## Party.fctr.All.X..rcv.glmnet.prob                                  0.7450408
## Party.fctr.All.X.range.rcv.glmnet.prob                             0.7450408
## Party.fctr.RFE.X.range.rcv.glmnet.prob                             0.7450408
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                       0.7538010
##                                              Party.fctr.All.X..rcv.glm.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                           0.9255725
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.2840822
## Party.fctr.RFE.X..rcv.rf.prob                                     0.5767768
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                       0.8062761
## Party.fctr.RFE.X..rcv.nnet.prob                                   0.8296469
## Party.fctr.RFE.X..rcv.avNNet.prob                                 0.8252145
## Party.fctr.All.X..rcv.glm.prob                                    1.0000000
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                        0.8611484
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.9205344
## Party.fctr.All.X..rcv.glmnet.prob                                 0.8740747
## Party.fctr.All.X.range.rcv.glmnet.prob                            0.8740747
## Party.fctr.RFE.X.range.rcv.glmnet.prob                            0.8740747
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                      0.8769625
##                                              Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                    1.0000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.3169478
## Party.fctr.RFE.X..rcv.rf.prob                                              0.5849997
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                0.8952551
## Party.fctr.RFE.X..rcv.nnet.prob                                            0.7891566
## Party.fctr.RFE.X..rcv.avNNet.prob                                          0.8074771
## Party.fctr.All.X..rcv.glm.prob                                             0.9255725
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                 0.9532567
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.9528914
## Party.fctr.All.X..rcv.glmnet.prob                                          0.9645156
## Party.fctr.All.X.range.rcv.glmnet.prob                                     0.9645156
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                     0.9645156
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                               0.9638358
##                                              Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                    0.9528914
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.3166969
## Party.fctr.RFE.X..rcv.rf.prob                                              0.5625146
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                0.8566523
## Party.fctr.RFE.X..rcv.nnet.prob                                            0.7759781
## Party.fctr.RFE.X..rcv.avNNet.prob                                          0.8074028
## Party.fctr.All.X..rcv.glm.prob                                             0.9205344
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                 0.9169026
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X..rcv.glmnet.prob                                          0.9274426
## Party.fctr.All.X.range.rcv.glmnet.prob                                     0.9274426
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                     0.9274426
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                               0.9295067
##                                              Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                             0.9633405
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.3611029
## Party.fctr.RFE.X..rcv.rf.prob                                                       0.5695557
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                         0.8894315
## Party.fctr.RFE.X..rcv.nnet.prob                                                     0.7771171
## Party.fctr.RFE.X..rcv.avNNet.prob                                                   0.8101480
## Party.fctr.All.X..rcv.glm.prob                                                      0.9014065
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                          0.9577354
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.9580909
## Party.fctr.All.X..rcv.glmnet.prob                                                   0.9721249
## Party.fctr.All.X.range.rcv.glmnet.prob                                              0.9721249
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                              0.9721249
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                                        0.9767559
##                                              Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                 0.9667987
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.3553095
## Party.fctr.RFE.X..rcv.rf.prob                                           0.5659386
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                             0.8949164
## Party.fctr.RFE.X..rcv.nnet.prob                                         0.7687517
## Party.fctr.RFE.X..rcv.avNNet.prob                                       0.7956346
## Party.fctr.All.X..rcv.glm.prob                                          0.9001967
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                              0.9636515
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.9574912
## Party.fctr.All.X..rcv.glmnet.prob                                       0.9781410
## Party.fctr.All.X.range.rcv.glmnet.prob                                  0.9781410
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                  0.9781410
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                            0.9771458
##                                              Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                         0.9638358
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.3316990
## Party.fctr.RFE.X..rcv.rf.prob                                                   0.5638367
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                     0.9109802
## Party.fctr.RFE.X..rcv.nnet.prob                                                 0.7538010
## Party.fctr.RFE.X..rcv.avNNet.prob                                               0.7745838
## Party.fctr.All.X..rcv.glm.prob                                                  0.8769625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.9817237
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.9295067
## Party.fctr.All.X..rcv.glmnet.prob                                               0.9970833
## Party.fctr.All.X.range.rcv.glmnet.prob                                          0.9970833
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                          0.9970833
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                                    1.0000000
##                                              Party.fctr.RFE.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                               0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                           0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                         0.7621485
## Party.fctr.All.X..rcv.glm.prob                                            0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.9839495
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.9274426
## Party.fctr.All.X..rcv.glmnet.prob                                         1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                                    1.0000000
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                    1.0000000
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                              0.9970833
##                                              Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                               0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                           0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                         0.7621485
## Party.fctr.All.X..rcv.glm.prob                                            0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.9839495
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.9274426
## Party.fctr.All.X..rcv.glmnet.prob                                         1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                                    1.0000000
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                    1.0000000
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                              0.9970833
##                                              Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                              0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                        0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                          0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                      0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                    0.7621485
## Party.fctr.All.X..rcv.glm.prob                                       0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                           0.9839495
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.9274426
## Party.fctr.All.X..rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                               1.0000000
## Party.fctr.RFE.X.range.rcv.glmnet.prob                               1.0000000
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                         0.9970833
##                                              Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                       0.9532567
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2888450
## Party.fctr.RFE.X..rcv.rf.prob                                                 0.5523091
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                   0.9683422
## Party.fctr.RFE.X..rcv.nnet.prob                                               0.7286555
## Party.fctr.RFE.X..rcv.avNNet.prob                                             0.7599499
## Party.fctr.All.X..rcv.glm.prob                                                0.8611484
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.9169026
## Party.fctr.All.X..rcv.glmnet.prob                                             0.9839495
## Party.fctr.All.X.range.rcv.glmnet.prob                                        0.9839495
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                        0.9839495
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                                  0.9817237
##                                              Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                        0.8952551
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2233505
## Party.fctr.RFE.X..rcv.rf.prob                                                  0.5177145
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                    1.0000000
## Party.fctr.RFE.X..rcv.nnet.prob                                                0.6727984
## Party.fctr.RFE.X..rcv.avNNet.prob                                              0.7207729
## Party.fctr.All.X..rcv.glm.prob                                                 0.8062761
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                     0.9683422
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.8566523
## Party.fctr.All.X..rcv.glmnet.prob                                              0.9122701
## Party.fctr.All.X.range.rcv.glmnet.prob                                         0.9122701
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                         0.9122701
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                                   0.9109802
##                                              Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                 0.3169478
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    1.0000000
## Party.fctr.RFE.X..rcv.rf.prob                                           0.1846677
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                             0.2233505
## Party.fctr.RFE.X..rcv.nnet.prob                                         0.3454953
## Party.fctr.RFE.X..rcv.avNNet.prob                                       0.3250021
## Party.fctr.All.X..rcv.glm.prob                                          0.2840822
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                              0.2888450
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.3166969
## Party.fctr.All.X..rcv.glmnet.prob                                       0.3232876
## Party.fctr.All.X.range.rcv.glmnet.prob                                  0.3232876
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                  0.3232876
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                            0.3316990
##          Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                                        0.8525338 
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob 
##                                        0.8523892 
##             Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                        0.8523275 
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob 
##                                        0.8521676 
##           Party.fctr.RFE.X.range.rcv.glmnet.prob 
##                                        0.8499499 
##           Party.fctr.All.X.range.rcv.glmnet.prob 
##                                        0.8499499 
##                Party.fctr.All.X..rcv.glmnet.prob 
##                                        0.8499499 
##       Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                        0.8433063 
##          Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                        0.8324160 
##                   Party.fctr.All.X..rcv.glm.prob 
##                                        0.8098799 
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob 
##                                        0.7929963 
##                Party.fctr.RFE.X..rcv.avNNet.prob 
##                                        0.7576938 
##                  Party.fctr.RFE.X..rcv.nnet.prob 
##                                        0.7308165 
##                    Party.fctr.RFE.X..rcv.rf.prob 
##                                        0.5784676 
##             Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                        0.3528192 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.14##rcv#glmnet"
## [1] "    indepVar: Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.725000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.212 on full training set
## [1] "myfit_mdl: train complete: 4.596000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0            96   -none-     numeric  
## beta        1440   dgCMatrix  S4       
## df            96   -none-     numeric  
## dim            2   -none-     numeric  
## lambda        96   -none-     numeric  
## dev.ratio     96   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        15   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.8570366                         0.4406734 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.1914988 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.9848102                         0.4918495 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.4039550 
## [1] "myfit_mdl: train diagnostics complete: 5.257000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score accuracy
## 9       0.40       1        1
## 10      0.45       1        1
## 11      0.50       1        1
## 12      0.55       1        1

##          Prediction
## Reference    D    R
##         D 2360    0
##         R    0 2093
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      1.0000000      1.0000000      0.9991719      1.0000000      0.5299798 
## AccuracyPValue  McnemarPValue 
##      0.0000000            NaN

##          Prediction
## Reference   D   R
##         D 512  79
##         R 405 119
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   5.659193e-01   9.684265e-02   5.362369e-01   5.952529e-01   5.300448e-01 
## AccuracyPValue  McnemarPValue 
##   8.804008e-03   2.196421e-49 
## [1] "myfit_mdl: predict complete: 19.196000 secs"
##                             id
## 1 Ensemble.auto.14##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 feats
## 1 Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      3.855                 0.134
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1               1            1            1               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5               1                1
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9991719                     1             1
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.552158    0.5871404    0.5171756       0.5560006
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                    0.6       0.3296399        0.5659193
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5362369             0.5952529    0.09684265
##   max.AccuracySD.fit max.KappaSD.fit
## 1                  0               0
## [1] "myfit_mdl: exit: 19.337000 secs"
## glmnet variable importance
## 
##                                              Overall
## Party.fctr.RFE.X..rcv.rf.prob                 100.00
## Party.fctr.RFE.X..rcv.avNNet.prob              14.13
## .rnorm                                          0.00
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob      0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob         0.00
## Party.fctr.All.X.range.rcv.glmnet.prob          0.00
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob    0.00
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob     0.00
## Party.fctr.All.X..rcv.glm.prob                  0.00
## Party.fctr.RFE.X..rcv.nnet.prob                 0.00
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob         0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob            0.00
## Party.fctr.All.X..rcv.glmnet.prob               0.00
## Party.fctr.All.X.nzv.rcv.glmnet.prob            0.00
## Party.fctr.RFE.X.range.rcv.glmnet.prob          0.00
##                                              Party.fctr.RFE.X..rcv.rf.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                          0.5849997
## Party.fctr.All.X.ica.rcv.glmnet.prob                             0.1846677
## Party.fctr.RFE.X..rcv.rf.prob                                    1.0000000
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                      0.5177145
## Party.fctr.RFE.X..rcv.nnet.prob                                  0.5627205
## Party.fctr.RFE.X..rcv.avNNet.prob                                0.7359313
## Party.fctr.All.X..rcv.glm.prob                                   0.5767768
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                       0.5523091
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                          0.5625146
## Party.fctr.All.X..rcv.glmnet.prob                                0.5595358
## Party.fctr.All.X.range.rcv.glmnet.prob                           0.5595358
## Party.fctr.RFE.X.range.rcv.glmnet.prob                           0.5595358
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                     0.5638367
## Party.fctr.All.X.nzv.rcv.glmnet.prob                             0.5659386
##                                              Party.fctr.RFE.X..rcv.avNNet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                              0.8074771
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.3250021
## Party.fctr.RFE.X..rcv.rf.prob                                        0.7359313
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                          0.7207729
## Party.fctr.RFE.X..rcv.nnet.prob                                      0.8072394
## Party.fctr.RFE.X..rcv.avNNet.prob                                    1.0000000
## Party.fctr.All.X..rcv.glm.prob                                       0.8252145
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                           0.7599499
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.8074028
## Party.fctr.All.X..rcv.glmnet.prob                                    0.7621485
## Party.fctr.All.X.range.rcv.glmnet.prob                               0.7621485
## Party.fctr.RFE.X.range.rcv.glmnet.prob                               0.7621485
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                         0.7745838
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                 0.7956346
##                                              Party.fctr.RFE.X..rcv.nnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                            0.7891566
## Party.fctr.All.X.ica.rcv.glmnet.prob                               0.3454953
## Party.fctr.RFE.X..rcv.rf.prob                                      0.5627205
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                        0.6727984
## Party.fctr.RFE.X..rcv.nnet.prob                                    1.0000000
## Party.fctr.RFE.X..rcv.avNNet.prob                                  0.8072394
## Party.fctr.All.X..rcv.glm.prob                                     0.8296469
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                         0.7286555
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                            0.7759781
## Party.fctr.All.X..rcv.glmnet.prob                                  0.7450408
## Party.fctr.All.X.range.rcv.glmnet.prob                             0.7450408
## Party.fctr.RFE.X.range.rcv.glmnet.prob                             0.7450408
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                       0.7538010
## Party.fctr.All.X.nzv.rcv.glmnet.prob                               0.7687517
##                                              Party.fctr.All.X..rcv.glm.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                           0.9255725
## Party.fctr.All.X.ica.rcv.glmnet.prob                              0.2840822
## Party.fctr.RFE.X..rcv.rf.prob                                     0.5767768
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                       0.8062761
## Party.fctr.RFE.X..rcv.nnet.prob                                   0.8296469
## Party.fctr.RFE.X..rcv.avNNet.prob                                 0.8252145
## Party.fctr.All.X..rcv.glm.prob                                    1.0000000
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                        0.8611484
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                           0.9205344
## Party.fctr.All.X..rcv.glmnet.prob                                 0.8740747
## Party.fctr.All.X.range.rcv.glmnet.prob                            0.8740747
## Party.fctr.RFE.X.range.rcv.glmnet.prob                            0.8740747
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                      0.8769625
## Party.fctr.All.X.nzv.rcv.glmnet.prob                              0.9001967
##                                              Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                    1.0000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.3169478
## Party.fctr.RFE.X..rcv.rf.prob                                              0.5849997
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                0.8952551
## Party.fctr.RFE.X..rcv.nnet.prob                                            0.7891566
## Party.fctr.RFE.X..rcv.avNNet.prob                                          0.8074771
## Party.fctr.All.X..rcv.glm.prob                                             0.9255725
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                 0.9532567
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    0.9528914
## Party.fctr.All.X..rcv.glmnet.prob                                          0.9645156
## Party.fctr.All.X.range.rcv.glmnet.prob                                     0.9645156
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                     0.9645156
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                               0.9638358
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                       0.9667987
##                                              Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                    0.9528914
## Party.fctr.All.X.ica.rcv.glmnet.prob                                       0.3166969
## Party.fctr.RFE.X..rcv.rf.prob                                              0.5625146
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                0.8566523
## Party.fctr.RFE.X..rcv.nnet.prob                                            0.7759781
## Party.fctr.RFE.X..rcv.avNNet.prob                                          0.8074028
## Party.fctr.All.X..rcv.glm.prob                                             0.9205344
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                 0.9169026
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X..rcv.glmnet.prob                                          0.9274426
## Party.fctr.All.X.range.rcv.glmnet.prob                                     0.9274426
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                     0.9274426
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                               0.9295067
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                       0.9574912
##                                              Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                             0.9633405
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.3611029
## Party.fctr.RFE.X..rcv.rf.prob                                                       0.5695557
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                         0.8894315
## Party.fctr.RFE.X..rcv.nnet.prob                                                     0.7771171
## Party.fctr.RFE.X..rcv.avNNet.prob                                                   0.8101480
## Party.fctr.All.X..rcv.glm.prob                                                      0.9014065
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                          0.9577354
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.9580909
## Party.fctr.All.X..rcv.glmnet.prob                                                   0.9721249
## Party.fctr.All.X.range.rcv.glmnet.prob                                              0.9721249
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                              0.9721249
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                                        0.9767559
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.9962762
##                                              Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                 0.9667987
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    0.3553095
## Party.fctr.RFE.X..rcv.rf.prob                                           0.5659386
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                             0.8949164
## Party.fctr.RFE.X..rcv.nnet.prob                                         0.7687517
## Party.fctr.RFE.X..rcv.avNNet.prob                                       0.7956346
## Party.fctr.All.X..rcv.glm.prob                                          0.9001967
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                              0.9636515
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.9574912
## Party.fctr.All.X..rcv.glmnet.prob                                       0.9781410
## Party.fctr.All.X.range.rcv.glmnet.prob                                  0.9781410
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                  0.9781410
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                            0.9771458
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    1.0000000
##                                              Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                         0.9638358
## Party.fctr.All.X.ica.rcv.glmnet.prob                                            0.3316990
## Party.fctr.RFE.X..rcv.rf.prob                                                   0.5638367
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                     0.9109802
## Party.fctr.RFE.X..rcv.nnet.prob                                                 0.7538010
## Party.fctr.RFE.X..rcv.avNNet.prob                                               0.7745838
## Party.fctr.All.X..rcv.glm.prob                                                  0.8769625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                      0.9817237
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                         0.9295067
## Party.fctr.All.X..rcv.glmnet.prob                                               0.9970833
## Party.fctr.All.X.range.rcv.glmnet.prob                                          0.9970833
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                          0.9970833
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                            0.9771458
##                                              Party.fctr.RFE.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                               0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                           0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                         0.7621485
## Party.fctr.All.X..rcv.glm.prob                                            0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.9839495
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.9274426
## Party.fctr.All.X..rcv.glmnet.prob                                         1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                                    1.0000000
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                    1.0000000
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                              0.9970833
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.9781410
##                                              Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                   0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                      0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                             0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                               0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                           0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                         0.7621485
## Party.fctr.All.X..rcv.glm.prob                                            0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                0.9839495
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                   0.9274426
## Party.fctr.All.X..rcv.glmnet.prob                                         1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                                    1.0000000
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                    1.0000000
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                              0.9970833
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                      0.9781410
##                                              Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                              0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                        0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                          0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                      0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                    0.7621485
## Party.fctr.All.X..rcv.glm.prob                                       0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                           0.9839495
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.9274426
## Party.fctr.All.X..rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                               1.0000000
## Party.fctr.RFE.X.range.rcv.glmnet.prob                               1.0000000
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                         0.9970833
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                 0.9781410
##                                              Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                       0.9532567
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.2888450
## Party.fctr.RFE.X..rcv.rf.prob                                                 0.5523091
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                   0.9683422
## Party.fctr.RFE.X..rcv.nnet.prob                                               0.7286555
## Party.fctr.RFE.X..rcv.avNNet.prob                                             0.7599499
## Party.fctr.All.X..rcv.glm.prob                                                0.8611484
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    1.0000000
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.9169026
## Party.fctr.All.X..rcv.glmnet.prob                                             0.9839495
## Party.fctr.All.X.range.rcv.glmnet.prob                                        0.9839495
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                        0.9839495
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                                  0.9817237
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          0.9636515
##                                              Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                        0.8952551
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.2233505
## Party.fctr.RFE.X..rcv.rf.prob                                                  0.5177145
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                    1.0000000
## Party.fctr.RFE.X..rcv.nnet.prob                                                0.6727984
## Party.fctr.RFE.X..rcv.avNNet.prob                                              0.7207729
## Party.fctr.All.X..rcv.glm.prob                                                 0.8062761
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                     0.9683422
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.8566523
## Party.fctr.All.X..rcv.glmnet.prob                                              0.9122701
## Party.fctr.All.X.range.rcv.glmnet.prob                                         0.9122701
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                         0.9122701
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                                   0.9109802
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                           0.8949164
##                                              Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                 0.3169478
## Party.fctr.All.X.ica.rcv.glmnet.prob                                    1.0000000
## Party.fctr.RFE.X..rcv.rf.prob                                           0.1846677
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                             0.2233505
## Party.fctr.RFE.X..rcv.nnet.prob                                         0.3454953
## Party.fctr.RFE.X..rcv.avNNet.prob                                       0.3250021
## Party.fctr.All.X..rcv.glm.prob                                          0.2840822
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                              0.2888450
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                 0.3166969
## Party.fctr.All.X..rcv.glmnet.prob                                       0.3232876
## Party.fctr.All.X.range.rcv.glmnet.prob                                  0.3232876
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                  0.3232876
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                            0.3316990
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                    0.3553095
##             Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                        0.8628756 
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob 
##                                        0.8626668 
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob 
##                                        0.8610946 
##          Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                                        0.8606956 
##           Party.fctr.RFE.X.range.rcv.glmnet.prob 
##                                        0.8591064 
##           Party.fctr.All.X.range.rcv.glmnet.prob 
##                                        0.8591064 
##                Party.fctr.All.X..rcv.glmnet.prob 
##                                        0.8591064 
##       Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                        0.8519024 
##          Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                        0.8413499 
##                   Party.fctr.All.X..rcv.glm.prob 
##                                        0.8163311 
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob 
##                                        0.8002764 
##                Party.fctr.RFE.X..rcv.avNNet.prob 
##                                        0.7604039 
##                  Party.fctr.RFE.X..rcv.nnet.prob 
##                                        0.7335261 
##                    Party.fctr.RFE.X..rcv.rf.prob 
##                                        0.5775726 
##             Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                        0.3529971 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.15##rcv#glmnet"
## [1] "    indepVar: Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.716000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.212 on full training set
## [1] "myfit_mdl: train complete: 4.613000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0            96   -none-     numeric  
## beta        1536   dgCMatrix  S4       
## df            96   -none-     numeric  
## dim            2   -none-     numeric  
## lambda        96   -none-     numeric  
## dev.ratio     96   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        16   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.8570366                         0.4406734 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.1914988 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.9848102                         0.4918495 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.4039550 
## [1] "myfit_mdl: train diagnostics complete: 5.289000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score accuracy
## 9       0.40       1        1
## 10      0.45       1        1
## 11      0.50       1        1
## 12      0.55       1        1

##          Prediction
## Reference    D    R
##         D 2360    0
##         R    0 2093
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      1.0000000      1.0000000      0.9991719      1.0000000      0.5299798 
## AccuracyPValue  McnemarPValue 
##      0.0000000            NaN

##          Prediction
## Reference   D   R
##         D 512  79
##         R 405 119
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   5.659193e-01   9.684265e-02   5.362369e-01   5.952529e-01   5.300448e-01 
## AccuracyPValue  McnemarPValue 
##   8.804008e-03   2.196421e-49 
## [1] "myfit_mdl: predict complete: 22.675000 secs"
##                             id
## 1 Ensemble.auto.15##rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  feats
## 1 Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      3.881                 0.138
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1               1            1            1               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5               1                1
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9991719                     1             1
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.552158    0.5871404    0.5171756       0.5560006
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                    0.6       0.3296399        0.5659193
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5362369             0.5952529    0.09684265
##   max.AccuracySD.fit max.KappaSD.fit
## 1                  0               0
## [1] "myfit_mdl: exit: 22.823000 secs"
## glmnet variable importance
## 
##                                                  Overall
## Party.fctr.RFE.X..rcv.rf.prob                     100.00
## Party.fctr.RFE.X..rcv.avNNet.prob                  14.13
## .rnorm                                              0.00
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob          0.00
## Party.fctr.All.X.range.rcv.glmnet.prob              0.00
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob    0.00
## Party.fctr.RFE.X.range.rcv.glmnet.prob              0.00
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob        0.00
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob             0.00
## Party.fctr.All.X..rcv.glm.prob                      0.00
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob             0.00
## Party.fctr.RFE.X..rcv.nnet.prob                     0.00
## Party.fctr.All.X.ica.rcv.glmnet.prob                0.00
## Party.fctr.All.X..rcv.glmnet.prob                   0.00
## Party.fctr.All.X.nzv.rcv.glmnet.prob                0.00
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob         0.00
##                                                  Party.fctr.RFE.X..rcv.rf.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                              0.5849997
## Party.fctr.All.X.ica.rcv.glmnet.prob                                 0.1846677
## Party.fctr.RFE.X..rcv.rf.prob                                        1.0000000
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                          0.5177145
## Party.fctr.RFE.X..rcv.nnet.prob                                      0.5627205
## Party.fctr.RFE.X..rcv.avNNet.prob                                    0.7359313
## Party.fctr.All.X..rcv.glm.prob                                       0.5767768
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                           0.5523091
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                              0.5625146
## Party.fctr.All.X..rcv.glmnet.prob                                    0.5595358
## Party.fctr.All.X.range.rcv.glmnet.prob                               0.5595358
## Party.fctr.RFE.X.range.rcv.glmnet.prob                               0.5595358
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                         0.5638367
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                 0.5659386
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob                     0.5695557
##                                                  Party.fctr.RFE.X..rcv.avNNet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.8074771
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.3250021
## Party.fctr.RFE.X..rcv.rf.prob                                            0.7359313
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                              0.7207729
## Party.fctr.RFE.X..rcv.nnet.prob                                          0.8072394
## Party.fctr.RFE.X..rcv.avNNet.prob                                        1.0000000
## Party.fctr.All.X..rcv.glm.prob                                           0.8252145
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                               0.7599499
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.8074028
## Party.fctr.All.X..rcv.glmnet.prob                                        0.7621485
## Party.fctr.All.X.range.rcv.glmnet.prob                                   0.7621485
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                   0.7621485
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                             0.7745838
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                     0.7956346
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob                         0.8101480
##                                                  Party.fctr.RFE.X..rcv.nnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                0.7891566
## Party.fctr.All.X.ica.rcv.glmnet.prob                                   0.3454953
## Party.fctr.RFE.X..rcv.rf.prob                                          0.5627205
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                            0.6727984
## Party.fctr.RFE.X..rcv.nnet.prob                                        1.0000000
## Party.fctr.RFE.X..rcv.avNNet.prob                                      0.8072394
## Party.fctr.All.X..rcv.glm.prob                                         0.8296469
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                             0.7286555
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                0.7759781
## Party.fctr.All.X..rcv.glmnet.prob                                      0.7450408
## Party.fctr.All.X.range.rcv.glmnet.prob                                 0.7450408
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                 0.7450408
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                           0.7538010
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                   0.7687517
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob                       0.7771171
##                                                  Party.fctr.All.X..rcv.glm.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                               0.9255725
## Party.fctr.All.X.ica.rcv.glmnet.prob                                  0.2840822
## Party.fctr.RFE.X..rcv.rf.prob                                         0.5767768
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                           0.8062761
## Party.fctr.RFE.X..rcv.nnet.prob                                       0.8296469
## Party.fctr.RFE.X..rcv.avNNet.prob                                     0.8252145
## Party.fctr.All.X..rcv.glm.prob                                        1.0000000
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                            0.8611484
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                               0.9205344
## Party.fctr.All.X..rcv.glmnet.prob                                     0.8740747
## Party.fctr.All.X.range.rcv.glmnet.prob                                0.8740747
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                0.8740747
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                          0.8769625
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                  0.9001967
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob                      0.9014065
##                                                  Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                        1.0000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.3169478
## Party.fctr.RFE.X..rcv.rf.prob                                                  0.5849997
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                    0.8952551
## Party.fctr.RFE.X..rcv.nnet.prob                                                0.7891566
## Party.fctr.RFE.X..rcv.avNNet.prob                                              0.8074771
## Party.fctr.All.X..rcv.glm.prob                                                 0.9255725
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                     0.9532567
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        0.9528914
## Party.fctr.All.X..rcv.glmnet.prob                                              0.9645156
## Party.fctr.All.X.range.rcv.glmnet.prob                                         0.9645156
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                         0.9645156
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                                   0.9638358
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                           0.9667987
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob                               0.9633405
##                                                  Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                        0.9528914
## Party.fctr.All.X.ica.rcv.glmnet.prob                                           0.3166969
## Party.fctr.RFE.X..rcv.rf.prob                                                  0.5625146
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                    0.8566523
## Party.fctr.RFE.X..rcv.nnet.prob                                                0.7759781
## Party.fctr.RFE.X..rcv.avNNet.prob                                              0.8074028
## Party.fctr.All.X..rcv.glm.prob                                                 0.9205344
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                     0.9169026
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                        1.0000000
## Party.fctr.All.X..rcv.glmnet.prob                                              0.9274426
## Party.fctr.All.X.range.rcv.glmnet.prob                                         0.9274426
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                         0.9274426
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                                   0.9295067
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                           0.9574912
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob                               0.9580909
##                                                  Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                                 0.9633405
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                    0.3611029
## Party.fctr.RFE.X..rcv.rf.prob                                                           0.5695557
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                             0.8894315
## Party.fctr.RFE.X..rcv.nnet.prob                                                         0.7771171
## Party.fctr.RFE.X..rcv.avNNet.prob                                                       0.8101480
## Party.fctr.All.X..rcv.glm.prob                                                          0.9014065
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                              0.9577354
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                                 0.9580909
## Party.fctr.All.X..rcv.glmnet.prob                                                       0.9721249
## Party.fctr.All.X.range.rcv.glmnet.prob                                                  0.9721249
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                                  0.9721249
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                                            0.9767559
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                    0.9962762
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob                                        1.0000000
##                                                  Party.fctr.All.X.nzv.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                     0.9667987
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        0.3553095
## Party.fctr.RFE.X..rcv.rf.prob                                               0.5659386
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                 0.8949164
## Party.fctr.RFE.X..rcv.nnet.prob                                             0.7687517
## Party.fctr.RFE.X..rcv.avNNet.prob                                           0.7956346
## Party.fctr.All.X..rcv.glm.prob                                              0.9001967
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                  0.9636515
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.9574912
## Party.fctr.All.X..rcv.glmnet.prob                                           0.9781410
## Party.fctr.All.X.range.rcv.glmnet.prob                                      0.9781410
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                      0.9781410
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                                0.9771458
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        1.0000000
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob                            0.9962762
##                                                  Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                             0.9638358
## Party.fctr.All.X.ica.rcv.glmnet.prob                                                0.3316990
## Party.fctr.RFE.X..rcv.rf.prob                                                       0.5638367
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                         0.9109802
## Party.fctr.RFE.X..rcv.nnet.prob                                                     0.7538010
## Party.fctr.RFE.X..rcv.avNNet.prob                                                   0.7745838
## Party.fctr.All.X..rcv.glm.prob                                                      0.8769625
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                          0.9817237
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                             0.9295067
## Party.fctr.All.X..rcv.glmnet.prob                                                   0.9970833
## Party.fctr.All.X.range.rcv.glmnet.prob                                              0.9970833
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                              0.9970833
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                                        1.0000000
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                                0.9771458
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob                                    0.9767559
##                                                  Party.fctr.RFE.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                       0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                                 0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                   0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                               0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                             0.7621485
## Party.fctr.All.X..rcv.glm.prob                                                0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.9839495
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.9274426
## Party.fctr.All.X..rcv.glmnet.prob                                             1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                                        1.0000000
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                        1.0000000
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                                  0.9970833
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          0.9781410
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob                              0.9721249
##                                                  Party.fctr.All.X.range.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                       0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                          0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                                 0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                   0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                               0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                             0.7621485
## Party.fctr.All.X..rcv.glm.prob                                                0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                    0.9839495
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                       0.9274426
## Party.fctr.All.X..rcv.glmnet.prob                                             1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                                        1.0000000
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                        1.0000000
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                                  0.9970833
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                          0.9781410
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob                              0.9721249
##                                                  Party.fctr.All.X..rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                  0.9645156
## Party.fctr.All.X.ica.rcv.glmnet.prob                                     0.3232876
## Party.fctr.RFE.X..rcv.rf.prob                                            0.5595358
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                              0.9122701
## Party.fctr.RFE.X..rcv.nnet.prob                                          0.7450408
## Party.fctr.RFE.X..rcv.avNNet.prob                                        0.7621485
## Party.fctr.All.X..rcv.glm.prob                                           0.8740747
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                               0.9839495
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                  0.9274426
## Party.fctr.All.X..rcv.glmnet.prob                                        1.0000000
## Party.fctr.All.X.range.rcv.glmnet.prob                                   1.0000000
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                   1.0000000
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                             0.9970833
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                     0.9781410
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob                         0.9721249
##                                                  Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                           0.9532567
## Party.fctr.All.X.ica.rcv.glmnet.prob                                              0.2888450
## Party.fctr.RFE.X..rcv.rf.prob                                                     0.5523091
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                       0.9683422
## Party.fctr.RFE.X..rcv.nnet.prob                                                   0.7286555
## Party.fctr.RFE.X..rcv.avNNet.prob                                                 0.7599499
## Party.fctr.All.X..rcv.glm.prob                                                    0.8611484
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                        1.0000000
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                           0.9169026
## Party.fctr.All.X..rcv.glmnet.prob                                                 0.9839495
## Party.fctr.All.X.range.rcv.glmnet.prob                                            0.9839495
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                            0.9839495
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                                      0.9817237
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                              0.9636515
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob                                  0.9577354
##                                                  Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                            0.8952551
## Party.fctr.All.X.ica.rcv.glmnet.prob                                               0.2233505
## Party.fctr.RFE.X..rcv.rf.prob                                                      0.5177145
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                        1.0000000
## Party.fctr.RFE.X..rcv.nnet.prob                                                    0.6727984
## Party.fctr.RFE.X..rcv.avNNet.prob                                                  0.7207729
## Party.fctr.All.X..rcv.glm.prob                                                     0.8062761
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                         0.9683422
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                            0.8566523
## Party.fctr.All.X..rcv.glmnet.prob                                                  0.9122701
## Party.fctr.All.X.range.rcv.glmnet.prob                                             0.9122701
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                             0.9122701
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                                       0.9109802
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                               0.8949164
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob                                   0.8894315
##                                                  Party.fctr.All.X.ica.rcv.glmnet.prob
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                                     0.3169478
## Party.fctr.All.X.ica.rcv.glmnet.prob                                        1.0000000
## Party.fctr.RFE.X..rcv.rf.prob                                               0.1846677
## Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob                                 0.2233505
## Party.fctr.RFE.X..rcv.nnet.prob                                             0.3454953
## Party.fctr.RFE.X..rcv.avNNet.prob                                           0.3250021
## Party.fctr.All.X..rcv.glm.prob                                              0.2840822
## Party.fctr.All.X.expoTrans.rcv.glmnet.prob                                  0.2888450
## Party.fctr.All.X.zv.pca.rcv.glmnet.prob                                     0.3166969
## Party.fctr.All.X..rcv.glmnet.prob                                           0.3232876
## Party.fctr.All.X.range.rcv.glmnet.prob                                      0.3232876
## Party.fctr.RFE.X.range.rcv.glmnet.prob                                      0.3232876
## Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob                                0.3316990
## Party.fctr.All.X.nzv.rcv.glmnet.prob                                        0.3553095
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob                            0.3611029
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob 
##                                        0.8718223 
##             Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                        0.8717689 
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob 
##                                        0.8688054 
##          Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 
##                                        0.8675386 
##           Party.fctr.RFE.X.range.rcv.glmnet.prob 
##                                        0.8666410 
##           Party.fctr.All.X.range.rcv.glmnet.prob 
##                                        0.8666410 
##                Party.fctr.All.X..rcv.glmnet.prob 
##                                        0.8666410 
##       Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                        0.8589579 
##          Party.fctr.All.X.zv.pca.rcv.glmnet.prob 
##                                        0.8491327 
##                   Party.fctr.All.X..rcv.glm.prob 
##                                        0.8220028 
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob 
##                                        0.8062200 
##                Party.fctr.RFE.X..rcv.avNNet.prob 
##                                        0.7637201 
##                  Party.fctr.RFE.X..rcv.nnet.prob 
##                                        0.7364322 
##                    Party.fctr.RFE.X..rcv.rf.prob 
##                                        0.5770382 
##             Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                        0.3535375 
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.2##boot#glmnet"
## [1] "    indepVar: Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.712000 secs"
## + Resample1: alpha=0.100, lambda=0.2118 
## - Resample1: alpha=0.100, lambda=0.2118 
## + Resample1: alpha=0.325, lambda=0.2118 
## - Resample1: alpha=0.325, lambda=0.2118 
## + Resample1: alpha=0.550, lambda=0.2118 
## - Resample1: alpha=0.550, lambda=0.2118 
## + Resample1: alpha=0.775, lambda=0.2118 
## - Resample1: alpha=0.775, lambda=0.2118 
## + Resample1: alpha=1.000, lambda=0.2118 
## - Resample1: alpha=1.000, lambda=0.2118 
## + Resample2: alpha=0.100, lambda=0.2118 
## - Resample2: alpha=0.100, lambda=0.2118 
## + Resample2: alpha=0.325, lambda=0.2118 
## - Resample2: alpha=0.325, lambda=0.2118 
## + Resample2: alpha=0.550, lambda=0.2118 
## - Resample2: alpha=0.550, lambda=0.2118 
## + Resample2: alpha=0.775, lambda=0.2118 
## - Resample2: alpha=0.775, lambda=0.2118 
## + Resample2: alpha=1.000, lambda=0.2118 
## - Resample2: alpha=1.000, lambda=0.2118 
## + Resample3: alpha=0.100, lambda=0.2118 
## - Resample3: alpha=0.100, lambda=0.2118 
## + Resample3: alpha=0.325, lambda=0.2118 
## - Resample3: alpha=0.325, lambda=0.2118 
## + Resample3: alpha=0.550, lambda=0.2118 
## - Resample3: alpha=0.550, lambda=0.2118 
## + Resample3: alpha=0.775, lambda=0.2118 
## - Resample3: alpha=0.775, lambda=0.2118 
## + Resample3: alpha=1.000, lambda=0.2118 
## - Resample3: alpha=1.000, lambda=0.2118 
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.212 on full training set
## [1] "myfit_mdl: train complete: 5.776000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0            96   -none-     numeric  
## beta        1536   dgCMatrix  S4       
## df            96   -none-     numeric  
## dim            2   -none-     numeric  
## lambda        96   -none-     numeric  
## dev.ratio     96   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        16   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.8570366                         0.4406734 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.1914988 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.9848102                         0.4918495 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.4039550 
## [1] "myfit_mdl: train diagnostics complete: 6.456000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score accuracy
## 9       0.40       1        1
## 10      0.45       1        1
## 11      0.50       1        1
## 12      0.55       1        1

##          Prediction
## Reference    D    R
##         D 2360    0
##         R    0 2093
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      1.0000000      1.0000000      0.9991719      1.0000000      0.5299798 
## AccuracyPValue  McnemarPValue 
##      0.0000000            NaN

##          Prediction
## Reference   D   R
##         D 512  79
##         R 405 119
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   5.659193e-01   9.684265e-02   5.362369e-01   5.952529e-01   5.300448e-01 
## AccuracyPValue  McnemarPValue 
##   8.804008e-03   2.196421e-49 
## [1] "myfit_mdl: predict complete: 20.374000 secs"
##                             id
## 1 Ensemble.auto.2##boot#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  feats
## 1 Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      5.048                 0.138
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1               1            1            1               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5               1                1
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9991719                     1             1
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.552158    0.5871404    0.5171756       0.5560006
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                    0.6       0.3296399        0.5659193
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5362369             0.5952529    0.09684265
##   max.AccuracySD.fit max.KappaSD.fit
## 1                  0               0
## [1] "myfit_mdl: exit: 20.516000 secs"
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.2##boot632#glmnet"
## [1] "    indepVar: Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.747000 secs"
## + AllData: alpha=0.100, lambda=0.2118 
## - AllData: alpha=0.100, lambda=0.2118 
## + AllData: alpha=0.325, lambda=0.2118 
## - AllData: alpha=0.325, lambda=0.2118 
## + AllData: alpha=0.550, lambda=0.2118 
## - AllData: alpha=0.550, lambda=0.2118 
## + AllData: alpha=0.775, lambda=0.2118 
## - AllData: alpha=0.775, lambda=0.2118 
## + AllData: alpha=1.000, lambda=0.2118 
## - AllData: alpha=1.000, lambda=0.2118 
## + Resample1: alpha=0.100, lambda=0.2118 
## - Resample1: alpha=0.100, lambda=0.2118 
## + Resample1: alpha=0.325, lambda=0.2118 
## - Resample1: alpha=0.325, lambda=0.2118 
## + Resample1: alpha=0.550, lambda=0.2118 
## - Resample1: alpha=0.550, lambda=0.2118 
## + Resample1: alpha=0.775, lambda=0.2118 
## - Resample1: alpha=0.775, lambda=0.2118 
## + Resample1: alpha=1.000, lambda=0.2118 
## - Resample1: alpha=1.000, lambda=0.2118 
## + Resample2: alpha=0.100, lambda=0.2118 
## - Resample2: alpha=0.100, lambda=0.2118 
## + Resample2: alpha=0.325, lambda=0.2118 
## - Resample2: alpha=0.325, lambda=0.2118 
## + Resample2: alpha=0.550, lambda=0.2118 
## - Resample2: alpha=0.550, lambda=0.2118 
## + Resample2: alpha=0.775, lambda=0.2118 
## - Resample2: alpha=0.775, lambda=0.2118 
## + Resample2: alpha=1.000, lambda=0.2118 
## - Resample2: alpha=1.000, lambda=0.2118 
## + Resample3: alpha=0.100, lambda=0.2118 
## - Resample3: alpha=0.100, lambda=0.2118 
## + Resample3: alpha=0.325, lambda=0.2118 
## - Resample3: alpha=0.325, lambda=0.2118 
## + Resample3: alpha=0.550, lambda=0.2118 
## - Resample3: alpha=0.550, lambda=0.2118 
## + Resample3: alpha=0.775, lambda=0.2118 
## - Resample3: alpha=0.775, lambda=0.2118 
## + Resample3: alpha=1.000, lambda=0.2118 
## - Resample3: alpha=1.000, lambda=0.2118 
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.212 on full training set
## [1] "myfit_mdl: train complete: 7.995000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0            96   -none-     numeric  
## beta        1536   dgCMatrix  S4       
## df            96   -none-     numeric  
## dim            2   -none-     numeric  
## lambda        96   -none-     numeric  
## dev.ratio     96   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        16   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.8570366                         0.4406734 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.1914988 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.9848102                         0.4918495 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.4039550 
## [1] "myfit_mdl: train diagnostics complete: 8.654000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score accuracy
## 9       0.40       1        1
## 10      0.45       1        1
## 11      0.50       1        1
## 12      0.55       1        1

##          Prediction
## Reference    D    R
##         D 2360    0
##         R    0 2093
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      1.0000000      1.0000000      0.9991719      1.0000000      0.5299798 
## AccuracyPValue  McnemarPValue 
##      0.0000000            NaN

##          Prediction
## Reference   D   R
##         D 512  79
##         R 405 119
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   5.659193e-01   9.684265e-02   5.362369e-01   5.952529e-01   5.300448e-01 
## AccuracyPValue  McnemarPValue 
##   8.804008e-03   2.196421e-49 
## [1] "myfit_mdl: predict complete: 22.348000 secs"
##                                id
## 1 Ensemble.auto.2##boot632#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  feats
## 1 Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      7.233                 0.139
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1               1            1            1               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5               1                1
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9991719                     1             1
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.552158    0.5871404    0.5171756       0.5560006
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                    0.6       0.3296399        0.5659193
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5362369             0.5952529    0.09684265
##   max.AccuracySD.fit max.KappaSD.fit max.AccuracyApparent.fit
## 1                  0               0                        1
##   max.KappaApparent.fit
## 1                     1
## [1] "myfit_mdl: exit: 22.575000 secs"
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.2##cv#glmnet"
## [1] "    indepVar: Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.704000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.212 on full training set
## [1] "myfit_mdl: train complete: 3.376000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0            96   -none-     numeric  
## beta        1536   dgCMatrix  S4       
## df            96   -none-     numeric  
## dim            2   -none-     numeric  
## lambda        96   -none-     numeric  
## dev.ratio     96   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        16   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.8570366                         0.4406734 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.1914988 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.9848102                         0.4918495 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.4039550 
## [1] "myfit_mdl: train diagnostics complete: 4.106000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score accuracy
## 9       0.40       1        1
## 10      0.45       1        1
## 11      0.50       1        1
## 12      0.55       1        1

##          Prediction
## Reference    D    R
##         D 2360    0
##         R    0 2093
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      1.0000000      1.0000000      0.9991719      1.0000000      0.5299798 
## AccuracyPValue  McnemarPValue 
##      0.0000000            NaN

##          Prediction
## Reference   D   R
##         D 512  79
##         R 405 119
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   5.659193e-01   9.684265e-02   5.362369e-01   5.952529e-01   5.300448e-01 
## AccuracyPValue  McnemarPValue 
##   8.804008e-03   2.196421e-49 
## [1] "myfit_mdl: predict complete: 17.936000 secs"
##                           id
## 1 Ensemble.auto.2##cv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  feats
## 1 Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.656                 0.138
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1               1            1            1               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5               1                1
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9991719                     1             1
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.552158    0.5871404    0.5171756       0.5560006
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                    0.6       0.3296399        0.5659193
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5362369             0.5952529    0.09684265
##   max.AccuracySD.fit max.KappaSD.fit
## 1                  0               0
## [1] "myfit_mdl: exit: 18.074000 secs"
## [1] "skipping fitting model: Ensemble.auto.2##rcv#glmnet"
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.2##LGOCV#glmnet"
## [1] "    indepVar: Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.704000 secs"
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.212 on full training set
## [1] "myfit_mdl: train complete: 3.477000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: lambda

##             Length Class      Mode     
## a0            96   -none-     numeric  
## beta        1536   dgCMatrix  S4       
## df            96   -none-     numeric  
## dim            2   -none-     numeric  
## lambda        96   -none-     numeric  
## dev.ratio     96   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        16   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.8570366                         0.4406734 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.1914988 
## [1] "max lambda < lambdaOpt:"
##                       (Intercept) Party.fctr.RFE.X..rcv.avNNet.prob 
##                        -1.9848102                         0.4918495 
##     Party.fctr.RFE.X..rcv.rf.prob 
##                         3.4039550 
## [1] "myfit_mdl: train diagnostics complete: 4.155000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score accuracy
## 9       0.40       1        1
## 10      0.45       1        1
## 11      0.50       1        1
## 12      0.55       1        1

##          Prediction
## Reference    D    R
##         D 2360    0
##         R    0 2093
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      1.0000000      1.0000000      0.9991719      1.0000000      0.5299798 
## AccuracyPValue  McnemarPValue 
##      0.0000000            NaN

##          Prediction
## Reference   D   R
##         D 512  79
##         R 405 119
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   5.659193e-01   9.684265e-02   5.362369e-01   5.952529e-01   5.300448e-01 
## AccuracyPValue  McnemarPValue 
##   8.804008e-03   2.196421e-49 
## [1] "myfit_mdl: predict complete: 18.073000 secs"
##                              id
## 1 Ensemble.auto.2##LGOCV#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  feats
## 1 Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      2.757                 0.138
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1               1            1            1               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5               1                1
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9991719                     1             1
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1        0.552158    0.5871404    0.5171756       0.5560006
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                    0.6       0.3296399        0.5659193
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5362369             0.5952529    0.09684265
##   max.AccuracySD.fit max.KappaSD.fit
## 1                  0               0
## [1] "myfit_mdl: exit: 18.227000 secs"
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Ensemble.auto.2##adaptive_cv#glmnet"
## [1] "    indepVar: Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob"
## [1] "myfit_mdl: setup complete: 0.725000 secs"
## o 1 eliminated;24 remain
## o 22 models of 24 were eliminated due to linear dependencies
## o 1 eliminated;1 remains
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.1, lambda = 0.0456 on full training set
## [1] "myfit_mdl: train complete: 6.167000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsMdlSpecs, indepVar = thsIndepVar, :
## model's bestTune found at an extreme of tuneGrid for parameter: alpha

##             Length Class      Mode     
## a0           100   -none-     numeric  
## beta        1600   dgCMatrix  S4       
## df           100   -none-     numeric  
## dim            2   -none-     numeric  
## lambda       100   -none-     numeric  
## dev.ratio    100   -none-     numeric  
## nulldev        1   -none-     numeric  
## npasses        1   -none-     numeric  
## jerr           1   -none-     numeric  
## offset         1   -none-     logical  
## classnames     2   -none-     character
## call           5   -none-     call     
## nobs           1   -none-     numeric  
## lambdaOpt      1   -none-     numeric  
## xNames        16   -none-     character
## problemType    1   -none-     character
## tuneValue      2   data.frame list     
## obsLevels      2   -none-     character
## [1] "min lambda > lambdaOpt:"
##                                      (Intercept) 
##                                      -3.63430207 
##                Party.fctr.All.X..rcv.glmnet.prob 
##                                      -0.02515902 
##       Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                      -0.06641737 
##             Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                      -0.44646377 
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob 
##                                      -0.01928634 
##           Party.fctr.All.X.range.rcv.glmnet.prob 
##                                      -0.02567766 
##                Party.fctr.RFE.X..rcv.avNNet.prob 
##                                       1.90766085 
##                  Party.fctr.RFE.X..rcv.nnet.prob 
##                                       0.07532917 
##                    Party.fctr.RFE.X..rcv.rf.prob 
##                                       5.96809493 
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob 
##                                      -0.04022132 
##           Party.fctr.RFE.X.range.rcv.glmnet.prob 
##                                      -0.02533417 
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob 
##                                      -0.03525588 
## [1] "max lambda < lambdaOpt:"
##                                      (Intercept) 
##                                      -3.66534235 
##                Party.fctr.All.X..rcv.glmnet.prob 
##                                      -0.04266304 
##       Party.fctr.All.X.expoTrans.rcv.glmnet.prob 
##                                      -0.08407474 
##             Party.fctr.All.X.ica.rcv.glmnet.prob 
##                                      -0.48953884 
##             Party.fctr.All.X.nzv.rcv.glmnet.prob 
##                                      -0.01790449 
## Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob 
##                                      -0.04604704 
##           Party.fctr.All.X.range.rcv.glmnet.prob 
##                                      -0.04259309 
##                Party.fctr.RFE.X..rcv.avNNet.prob 
##                                       1.95234372 
##                  Party.fctr.RFE.X..rcv.nnet.prob 
##                                       0.07228477 
##                    Party.fctr.RFE.X..rcv.rf.prob 
##                                       6.17924802 
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob 
##                                      -0.05653815 
##           Party.fctr.RFE.X.range.rcv.glmnet.prob 
##                                      -0.04253886 
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob 
##                                      -0.05511343 
## [1] "myfit_mdl: train diagnostics complete: 6.842000 secs"

## [1] "mypredict_mdl: maxMetricDf:"
##    threshold f.score accuracy
## 9       0.40       1        1
## 10      0.45       1        1
## 11      0.50       1        1
## 12      0.55       1        1

##          Prediction
## Reference    D    R
##         D 2360    0
##         R    0 2093
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##      1.0000000      1.0000000      0.9991719      1.0000000      0.5299798 
## AccuracyPValue  McnemarPValue 
##      0.0000000            NaN

##          Prediction
## Reference   D   R
##         D 494  97
##         R 379 145
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   5.730942e-01   1.161316e-01   5.434518e-01   6.023498e-01   5.300448e-01 
## AccuracyPValue  McnemarPValue 
##   2.144973e-03   5.862813e-38 
## [1] "myfit_mdl: predict complete: 20.908000 secs"
##                                    id
## 1 Ensemble.auto.2##adaptive_cv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  feats
## 1 Party.fctr.RFE.X.Inc..rcv.bagEarth.prob,.rnorm,Party.fctr.All.X.ica.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.rf.prob,Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob,Party.fctr.RFE.X..rcv.nnet.prob,Party.fctr.RFE.X..rcv.avNNet.prob,Party.fctr.All.X..rcv.glm.prob,Party.fctr.All.X.expoTrans.rcv.glmnet.prob,Party.fctr.All.X.zv.pca.rcv.glmnet.prob,Party.fctr.All.X..rcv.glmnet.prob,Party.fctr.All.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.range.rcv.glmnet.prob,Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob,Party.fctr.All.X.nzv.rcv.glmnet.prob,Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              25                      5.425                  0.24
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1               1            1            1               1
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5               1                1
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.9991719                     1             1
##   max.AUCpROC.OOB max.Sens.OOB max.Spec.OOB max.AUCROCR.OOB
## 1       0.5501802    0.5583756    0.5419847       0.5594251
##   opt.prob.threshold.OOB max.f.score.OOB max.Accuracy.OOB
## 1                    0.7       0.3785901        0.5730942
##   max.AccuracyLower.OOB max.AccuracyUpper.OOB max.Kappa.OOB
## 1             0.5434518             0.6023498     0.1161316
##   max.AccuracySD.fit max.KappaSD.fit max..B.fit
## 1                  0               0         21
## [1] "myfit_mdl: exit: 21.051000 secs"

## glmnet 
## 
## 4453 samples
##    3 predictor
##    2 classes: 'D', 'R' 
## 
## No pre-processing
## Resampling: Cross-Validated (3 fold, repeated 3 times) 
## Summary of sample sizes: 2969, 2969, 2968, 2968, 2970, 2968, ... 
## Resampling results across tuning parameters:
## 
##   alpha  lambda       Accuracy   Kappa    
##   0.100  0.000941307  0.6840360  0.3653855
##   0.100  0.004369160  0.6842605  0.3657754
##   0.100  0.020279845  0.6833626  0.3637280
##   0.100  0.094130700  0.6812671  0.3579972
##   0.325  0.000941307  0.6841109  0.3655303
##   0.325  0.004369160  0.6841108  0.3654491
##   0.325  0.020279845  0.6832872  0.3635281
##   0.325  0.094130700  0.6815661  0.3584944
##   0.550  0.000941307  0.6841856  0.3657095
##   0.550  0.004369160  0.6843356  0.3659057
##   0.550  0.020279845  0.6833621  0.3636502
##   0.550  0.094130700  0.6811916  0.3573628
##   0.775  0.000941307  0.6846348  0.3665767
##   0.775  0.004369160  0.6837370  0.3647487
##   0.775  0.020279845  0.6832872  0.3634945
##   0.775  0.094130700  0.6802932  0.3550880
##   1.000  0.000941307  0.6845601  0.3664431
##   1.000  0.004369160  0.6842608  0.3658074
##   1.000  0.020279845  0.6833621  0.3636392
##   1.000  0.094130700  0.6815665  0.3570573
## 
## Accuracy was used to select the optimal model using  the largest value.
## The final values used for the model were alpha = 0.775 and lambda
##  = 0.000941307.
## [1] "Ensemble.auto.2##rcv#glmnet fit prediction diagnostics:"
## [1] "Ensemble.auto.2##rcv#glmnet OOB prediction diagnostics:"
##                                         Ensemble.auto.2..rcv.glmnet.imp
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                      100.000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                           9.724945
## .rnorm                                                         0.000000
##                                                imp
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 100.000000
## Party.fctr.All.X.ica.rcv.glmnet.prob      9.724945
## .rnorm                                    0.000000

## Loading required package: lazyeval

## [1] "Min/Max Boundaries: "
##   USER_ID Party.fctr Party.fctr.RFE.X.Inc..rcv.bagEarth
## 1    3834          R                                  D
## 2    3256          R                                  R
##   Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## 1                               0.3376589
## 2                               0.6088904
##   Party.fctr.RFE.X.Inc..rcv.bagEarth.is.acc
## 1                                     FALSE
## 2                                      TRUE
##   Party.fctr.RFE.X.Inc..rcv.bagEarth.err
## 1                                   TRUE
## 2                                  FALSE
##   Party.fctr.RFE.X.Inc..rcv.bagEarth.err.abs
## 1                                  0.6623411
## 2                                  0.3911096
##   Party.fctr.RFE.X..rcv.bagEarth Party.fctr.RFE.X..rcv.bagEarth.prob
## 1                              D                           0.3466015
## 2                              R                           0.6151912
##   Party.fctr.RFE.X..rcv.bagEarth.is.acc Party.fctr.RFE.X..rcv.bagEarth.err
## 1                                 FALSE                               TRUE
## 2                                  TRUE                              FALSE
##   Party.fctr.RFE.X..rcv.bagEarth.err.abs
## 1                              0.6533985
## 2                              0.3848088
##   Party.fctr.RFE.X.zv.pca.rcv.glmnet
## 1                                  D
## 2                                  D
##   Party.fctr.RFE.X.zv.pca.rcv.glmnet.prob
## 1                               0.3018035
## 2                               0.4798474
##   Party.fctr.RFE.X.zv.pca.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                     FALSE
##   Party.fctr.RFE.X.zv.pca.rcv.glmnet.err
## 1                                   TRUE
## 2                                   TRUE
##   Party.fctr.RFE.X.zv.pca.rcv.glmnet.err.abs
## 1                                  0.6981965
## 2                                  0.5201526
##   Party.fctr.All.X.nzv.spatialSign.rcv.glmnet
## 1                                           D
## 2                                           D
##   Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## 1                                        0.3736393
## 2                                        0.5627253
##   Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.is.acc
## 1                                              FALSE
## 2                                              FALSE
##   Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.err
## 1                                            TRUE
## 2                                            TRUE
##   Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.err.abs
## 1                                           0.6263607
## 2                                           0.4372747
##   Party.fctr.All.X.spatialSign.rcv.glmnet
## 1                                       D
## 2                                       D
##   Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## 1                                    0.4165017
## 2                                    0.5866337
##   Party.fctr.All.X.spatialSign.rcv.glmnet.is.acc
## 1                                          FALSE
## 2                                          FALSE
##   Party.fctr.All.X.spatialSign.rcv.glmnet.err
## 1                                        TRUE
## 2                                        TRUE
##   Party.fctr.All.X.spatialSign.rcv.glmnet.err.abs
## 1                                       0.5834983
## 2                                       0.4133663
##   Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet
## 1                                           D
## 2                                           D
##   Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.prob
## 1                                        0.3746547
## 2                                        0.5653648
##   Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.is.acc
## 1                                              FALSE
## 2                                              FALSE
##   Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.err
## 1                                            TRUE
## 2                                            TRUE
##   Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.err.abs
## 1                                           0.6253453
## 2                                           0.4346352
##   Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet
## 1                                               D
## 2                                               D
##   Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.prob
## 1                                            0.4012486
## 2                                            0.5592673
##   Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.is.acc
## 1                                                  FALSE
## 2                                                  FALSE
##   Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.err
## 1                                                TRUE
## 2                                                TRUE
##   Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.err.abs
## 1                                               0.5987514
## 2                                               0.4407327
##   Party.fctr.RFE.X.spatialSign.rcv.glmnet
## 1                                       D
## 2                                       D
##   Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## 1                                    0.4157999
## 2                                    0.5884135
##   Party.fctr.RFE.X.spatialSign.rcv.glmnet.is.acc
## 1                                          FALSE
## 2                                          FALSE
##   Party.fctr.RFE.X.spatialSign.rcv.glmnet.err
## 1                                        TRUE
## 2                                        TRUE
##   Party.fctr.RFE.X.spatialSign.rcv.glmnet.err.abs
## 1                                       0.5842001
## 2                                       0.4115865
##   Party.fctr.All.X.nzv.rcv.glmnet Party.fctr.All.X.nzv.rcv.glmnet.prob
## 1                               D                            0.3638386
## 2                               D                            0.5812871
##   Party.fctr.All.X.nzv.rcv.glmnet.is.acc
## 1                                  FALSE
## 2                                  FALSE
##   Party.fctr.All.X.nzv.rcv.glmnet.err
## 1                                TRUE
## 2                                TRUE
##   Party.fctr.All.X.nzv.rcv.glmnet.err.abs Party.fctr.RFE.X.nzv.rcv.glmnet
## 1                               0.6361614                               D
## 2                               0.4187129                               R
##   Party.fctr.RFE.X.nzv.rcv.glmnet.prob
## 1                            0.3655426
## 2                            0.5830362
##   Party.fctr.RFE.X.nzv.rcv.glmnet.is.acc
## 1                                  FALSE
## 2                                   TRUE
##   Party.fctr.RFE.X.nzv.rcv.glmnet.err
## 1                                TRUE
## 2                               FALSE
##   Party.fctr.RFE.X.nzv.rcv.glmnet.err.abs
## 1                               0.6344574
## 2                               0.4169638
##   Party.fctr.All.X.expoTrans.rcv.glmnet
## 1                                     D
## 2                                     R
##   Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## 1                                  0.4131383
## 2                                  0.5977025
##   Party.fctr.All.X.expoTrans.rcv.glmnet.is.acc
## 1                                        FALSE
## 2                                         TRUE
##   Party.fctr.All.X.expoTrans.rcv.glmnet.err
## 1                                      TRUE
## 2                                     FALSE
##   Party.fctr.All.X.expoTrans.rcv.glmnet.err.abs
## 1                                     0.5868617
## 2                                     0.4022975
##   Party.fctr.RFE.X.expoTrans.rcv.glmnet
## 1                                     D
## 2                                     R
##   Party.fctr.RFE.X.expoTrans.rcv.glmnet.prob
## 1                                  0.4131383
## 2                                  0.5977025
##   Party.fctr.RFE.X.expoTrans.rcv.glmnet.is.acc
## 1                                        FALSE
## 2                                         TRUE
##   Party.fctr.RFE.X.expoTrans.rcv.glmnet.err
## 1                                      TRUE
## 2                                     FALSE
##   Party.fctr.RFE.X.expoTrans.rcv.glmnet.err.abs
## 1                                     0.5868617
## 2                                     0.4022975
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet
## 1                                      D
## 2                                      R
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## 1                                   0.4133282
## 2                                   0.5976144
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.is.acc
## 1                                         FALSE
## 2                                          TRUE
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.err
## 1                                       TRUE
## 2                                      FALSE
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.err.abs
## 1                                      0.5866718
## 2                                      0.4023856
##   Party.fctr.RFE.X.YeoJohnson.rcv.glmnet
## 1                                      D
## 2                                      R
##   Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## 1                                   0.4133282
## 2                                   0.5976144
##   Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.is.acc
## 1                                         FALSE
## 2                                          TRUE
##   Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.err
## 1                                       TRUE
## 2                                      FALSE
##   Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.err.abs
## 1                                      0.5866718
## 2                                      0.4023856
##   Party.fctr.RFE.X..rcv.rpart Party.fctr.RFE.X..rcv.rpart.prob
## 1                           D                        0.4638143
## 2                           R                        0.6035857
##   Party.fctr.RFE.X..rcv.rpart.is.acc Party.fctr.RFE.X..rcv.rpart.err
## 1                              FALSE                            TRUE
## 2                               TRUE                           FALSE
##   Party.fctr.RFE.X..rcv.rpart.err.abs Party.fctr.RFE.X..rcv.glmnet
## 1                           0.5361857                            D
## 2                           0.3964143                            R
##   Party.fctr.RFE.X..rcv.glmnet.prob Party.fctr.RFE.X..rcv.glmnet.is.acc
## 1                         0.4122638                               FALSE
## 2                         0.5984909                                TRUE
##   Party.fctr.RFE.X..rcv.glmnet.err Party.fctr.RFE.X..rcv.glmnet.err.abs
## 1                             TRUE                            0.5877362
## 2                            FALSE                            0.4015091
##   Party.fctr.All.X.conditionalX.rcv.glmnet
## 1                                        D
## 2                                        R
##   Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## 1                                     0.4122638
## 2                                     0.5984909
##   Party.fctr.All.X.conditionalX.rcv.glmnet.is.acc
## 1                                           FALSE
## 2                                            TRUE
##   Party.fctr.All.X.conditionalX.rcv.glmnet.err
## 1                                         TRUE
## 2                                        FALSE
##   Party.fctr.All.X.conditionalX.rcv.glmnet.err.abs
## 1                                        0.5877362
## 2                                        0.4015091
##   Party.fctr.All.X..rcv.glmnet Party.fctr.All.X..rcv.glmnet.prob
## 1                            D                         0.4122638
## 2                            R                         0.5984909
##   Party.fctr.All.X..rcv.glmnet.is.acc Party.fctr.All.X..rcv.glmnet.err
## 1                               FALSE                             TRUE
## 2                                TRUE                            FALSE
##   Party.fctr.All.X..rcv.glmnet.err.abs Party.fctr.Low.cor.X..rcv.glmnet
## 1                            0.5877362                                D
## 2                            0.4015091                                R
##   Party.fctr.Low.cor.X..rcv.glmnet.prob
## 1                             0.4122638
## 2                             0.5984909
##   Party.fctr.Low.cor.X..rcv.glmnet.is.acc
## 1                                   FALSE
## 2                                    TRUE
##   Party.fctr.Low.cor.X..rcv.glmnet.err
## 1                                 TRUE
## 2                                FALSE
##   Party.fctr.Low.cor.X..rcv.glmnet.err.abs
## 1                                0.5877362
## 2                                0.4015091
##   Party.fctr.RFE.X.conditionalX.rcv.glmnet
## 1                                        D
## 2                                        R
##   Party.fctr.RFE.X.conditionalX.rcv.glmnet.prob
## 1                                     0.4122638
## 2                                     0.5984909
##   Party.fctr.RFE.X.conditionalX.rcv.glmnet.is.acc
## 1                                           FALSE
## 2                                            TRUE
##   Party.fctr.RFE.X.conditionalX.rcv.glmnet.err
## 1                                         TRUE
## 2                                        FALSE
##   Party.fctr.RFE.X.conditionalX.rcv.glmnet.err.abs
## 1                                        0.5877362
## 2                                        0.4015091
##   Party.fctr.All.X.zv.rcv.glmnet Party.fctr.All.X.zv.rcv.glmnet.prob
## 1                              D                           0.4122638
## 2                              R                           0.5984909
##   Party.fctr.All.X.zv.rcv.glmnet.is.acc Party.fctr.All.X.zv.rcv.glmnet.err
## 1                                 FALSE                               TRUE
## 2                                  TRUE                              FALSE
##   Party.fctr.All.X.zv.rcv.glmnet.err.abs Party.fctr.RFE.X.zv.rcv.glmnet
## 1                              0.5877362                              D
## 2                              0.4015091                              R
##   Party.fctr.RFE.X.zv.rcv.glmnet.prob
## 1                           0.4122638
## 2                           0.5984909
##   Party.fctr.RFE.X.zv.rcv.glmnet.is.acc Party.fctr.RFE.X.zv.rcv.glmnet.err
## 1                                 FALSE                               TRUE
## 2                                  TRUE                              FALSE
##   Party.fctr.RFE.X.zv.rcv.glmnet.err.abs Party.fctr.RFE.X.scale.rcv.glmnet
## 1                              0.5877362                                 D
## 2                              0.4015091                                 R
##   Party.fctr.RFE.X.scale.rcv.glmnet.prob
## 1                              0.4122638
## 2                              0.5984909
##   Party.fctr.RFE.X.scale.rcv.glmnet.is.acc
## 1                                    FALSE
## 2                                     TRUE
##   Party.fctr.RFE.X.scale.rcv.glmnet.err
## 1                                  TRUE
## 2                                 FALSE
##   Party.fctr.RFE.X.scale.rcv.glmnet.err.abs
## 1                                 0.5877362
## 2                                 0.4015091
##   Party.fctr.RFE.X.center.rcv.glmnet
## 1                                  D
## 2                                  R
##   Party.fctr.RFE.X.center.rcv.glmnet.prob
## 1                               0.4122638
## 2                               0.5984909
##   Party.fctr.RFE.X.center.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                      TRUE
##   Party.fctr.RFE.X.center.rcv.glmnet.err
## 1                                   TRUE
## 2                                  FALSE
##   Party.fctr.RFE.X.center.rcv.glmnet.err.abs
## 1                                  0.5877362
## 2                                  0.4015091
##   Party.fctr.All.X.scale.rcv.glmnet Party.fctr.All.X.scale.rcv.glmnet.prob
## 1                                 D                              0.4122638
## 2                                 R                              0.5984909
##   Party.fctr.All.X.scale.rcv.glmnet.is.acc
## 1                                    FALSE
## 2                                     TRUE
##   Party.fctr.All.X.scale.rcv.glmnet.err
## 1                                  TRUE
## 2                                 FALSE
##   Party.fctr.All.X.scale.rcv.glmnet.err.abs
## 1                                 0.5877362
## 2                                 0.4015091
##   Party.fctr.All.X.center.rcv.glmnet
## 1                                  D
## 2                                  R
##   Party.fctr.All.X.center.rcv.glmnet.prob
## 1                               0.4122638
## 2                               0.5984909
##   Party.fctr.All.X.center.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                      TRUE
##   Party.fctr.All.X.center.rcv.glmnet.err
## 1                                   TRUE
## 2                                  FALSE
##   Party.fctr.All.X.center.rcv.glmnet.err.abs
## 1                                  0.5877362
## 2                                  0.4015091
##   Party.fctr.RFE.X.range.rcv.glmnet Party.fctr.RFE.X.range.rcv.glmnet.prob
## 1                                 D                              0.4122638
## 2                                 R                              0.5984909
##   Party.fctr.RFE.X.range.rcv.glmnet.is.acc
## 1                                    FALSE
## 2                                     TRUE
##   Party.fctr.RFE.X.range.rcv.glmnet.err
## 1                                  TRUE
## 2                                 FALSE
##   Party.fctr.RFE.X.range.rcv.glmnet.err.abs
## 1                                 0.5877362
## 2                                 0.4015091
##   Party.fctr.RFE.X.BoxCox.rcv.glmnet
## 1                                  D
## 2                                  R
##   Party.fctr.RFE.X.BoxCox.rcv.glmnet.prob
## 1                               0.4122638
## 2                               0.5984909
##   Party.fctr.RFE.X.BoxCox.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                      TRUE
##   Party.fctr.RFE.X.BoxCox.rcv.glmnet.err
## 1                                   TRUE
## 2                                  FALSE
##   Party.fctr.RFE.X.BoxCox.rcv.glmnet.err.abs
## 1                                  0.5877362
## 2                                  0.4015091
##   Party.fctr.All.X.range.rcv.glmnet Party.fctr.All.X.range.rcv.glmnet.prob
## 1                                 D                              0.4122638
## 2                                 R                              0.5984909
##   Party.fctr.All.X.range.rcv.glmnet.is.acc
## 1                                    FALSE
## 2                                     TRUE
##   Party.fctr.All.X.range.rcv.glmnet.err
## 1                                  TRUE
## 2                                 FALSE
##   Party.fctr.All.X.range.rcv.glmnet.err.abs
## 1                                 0.5877362
## 2                                 0.4015091
##   Party.fctr.All.X.BoxCox.rcv.glmnet
## 1                                  D
## 2                                  R
##   Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## 1                               0.4122638
## 2                               0.5984909
##   Party.fctr.All.X.BoxCox.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                      TRUE
##   Party.fctr.All.X.BoxCox.rcv.glmnet.err
## 1                                   TRUE
## 2                                  FALSE
##   Party.fctr.All.X.BoxCox.rcv.glmnet.err.abs
## 1                                  0.5877362
## 2                                  0.4015091
##   Party.fctr.RFE.X.center.scale.rcv.glmnet
## 1                                        D
## 2                                        R
##   Party.fctr.RFE.X.center.scale.rcv.glmnet.prob
## 1                                     0.4122638
## 2                                     0.5984909
##   Party.fctr.RFE.X.center.scale.rcv.glmnet.is.acc
## 1                                           FALSE
## 2                                            TRUE
##   Party.fctr.RFE.X.center.scale.rcv.glmnet.err
## 1                                         TRUE
## 2                                        FALSE
##   Party.fctr.RFE.X.center.scale.rcv.glmnet.err.abs
## 1                                        0.5877362
## 2                                        0.4015091
##   Party.fctr.All.X.center.scale.rcv.glmnet
## 1                                        D
## 2                                        R
##   Party.fctr.All.X.center.scale.rcv.glmnet.prob
## 1                                     0.4122638
## 2                                     0.5984909
##   Party.fctr.All.X.center.scale.rcv.glmnet.is.acc
## 1                                           FALSE
## 2                                            TRUE
##   Party.fctr.All.X.center.scale.rcv.glmnet.err
## 1                                         TRUE
## 2                                        FALSE
##   Party.fctr.All.X.center.scale.rcv.glmnet.err.abs
## 1                                        0.5877362
## 2                                        0.4015091
##   Party.fctr.All.X.zv.pca.rcv.glmnet
## 1                                  D
## 2                                  R
##   Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## 1                               0.3323528
## 2                               0.5111277
##   Party.fctr.All.X.zv.pca.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                      TRUE
##   Party.fctr.All.X.zv.pca.rcv.glmnet.err
## 1                                   TRUE
## 2                                  FALSE
##   Party.fctr.All.X.zv.pca.rcv.glmnet.err.abs Party.fctr.RFE.X..rcv.gbm
## 1                                  0.6676472                         D
## 2                                  0.4888723                         D
##   Party.fctr.RFE.X..rcv.gbm.prob Party.fctr.RFE.X..rcv.gbm.is.acc
## 1                      0.4018993                            FALSE
## 2                      0.5979299                            FALSE
##   Party.fctr.RFE.X..rcv.gbm.err Party.fctr.RFE.X..rcv.gbm.err.abs
## 1                          TRUE                         0.5981007
## 2                          TRUE                         0.4020701
##   Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet
## 1                                               D
## 2                                               D
##   Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.prob
## 1                                            0.4202423
## 2                                            0.4810540
##   Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.is.acc
## 1                                                  FALSE
## 2                                                  FALSE
##   Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.err
## 1                                                TRUE
## 2                                                TRUE
##   Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.err.abs
## 1                                               0.5797577
## 2                                               0.5189460
##   Party.fctr.RFE.X..rcv.earth Party.fctr.RFE.X..rcv.earth.prob
## 1                           D                        0.3460693
## 2                           R                        0.6149909
##   Party.fctr.RFE.X..rcv.earth.is.acc Party.fctr.RFE.X..rcv.earth.err
## 1                              FALSE                            TRUE
## 2                               TRUE                           FALSE
##   Party.fctr.RFE.X..rcv.earth.err.abs Party.fctr.RFE.X..rcv.glm
## 1                           0.6539307                         D
## 2                           0.3850091                         D
##   Party.fctr.RFE.X..rcv.glm.prob Party.fctr.RFE.X..rcv.glm.is.acc
## 1                      0.3617507                            FALSE
## 2                      0.5755799                            FALSE
##   Party.fctr.RFE.X..rcv.glm.err Party.fctr.RFE.X..rcv.glm.err.abs
## 1                          TRUE                         0.6382493
## 2                          TRUE                         0.4244201
##   Party.fctr.All.X..rcv.glm Party.fctr.All.X..rcv.glm.prob
## 1                         D                      0.3530866
## 2                         D                      0.5641632
##   Party.fctr.All.X..rcv.glm.is.acc Party.fctr.All.X..rcv.glm.err
## 1                            FALSE                          TRUE
## 2                            FALSE                          TRUE
##   Party.fctr.All.X..rcv.glm.err.abs Party.fctr.RFE.X..rcv.rf
## 1                         0.6469134                        D
## 2                         0.4358368                        D
##   Party.fctr.RFE.X..rcv.rf.prob Party.fctr.RFE.X..rcv.rf.is.acc
## 1                         0.368                           FALSE
## 2                         0.554                           FALSE
##   Party.fctr.RFE.X..rcv.rf.err Party.fctr.RFE.X..rcv.rf.err.abs
## 1                         TRUE                            0.632
## 2                         TRUE                            0.446
##   Party.fctr.RFE.X..rcv.avNNet Party.fctr.RFE.X..rcv.avNNet.prob
## 1                            D                         0.2062058
## 2                            D                         0.4227103
##   Party.fctr.RFE.X..rcv.avNNet.is.acc Party.fctr.RFE.X..rcv.avNNet.err
## 1                               FALSE                             TRUE
## 2                               FALSE                             TRUE
##   Party.fctr.RFE.X..rcv.avNNet.err.abs Party.fctr.RFE.X..rcv.nnet
## 1                            0.7937942                          D
## 2                            0.5772897                          D
##   Party.fctr.RFE.X..rcv.nnet.prob Party.fctr.RFE.X..rcv.nnet.is.acc
## 1                       0.1875107                             FALSE
## 2                       0.2139304                             FALSE
##   Party.fctr.RFE.X..rcv.nnet.err Party.fctr.RFE.X..rcv.nnet.err.abs
## 1                           TRUE                          0.8124893
## 2                           TRUE                          0.7860696
##   Party.fctr.RFE.X.ica.rcv.glmnet Party.fctr.RFE.X.ica.rcv.glmnet.prob
## 1                               D                            0.3785691
## 2                               D                            0.4400083
##   Party.fctr.RFE.X.ica.rcv.glmnet.is.acc
## 1                                  FALSE
## 2                                  FALSE
##   Party.fctr.RFE.X.ica.rcv.glmnet.err
## 1                                TRUE
## 2                                TRUE
##   Party.fctr.RFE.X.ica.rcv.glmnet.err.abs Party.fctr.All.X.ica.rcv.glmnet
## 1                               0.6214309                               D
## 2                               0.5599917                               D
##   Party.fctr.All.X.ica.rcv.glmnet.prob
## 1                            0.3760502
## 2                            0.4422982
##   Party.fctr.All.X.ica.rcv.glmnet.is.acc
## 1                                  FALSE
## 2                                  FALSE
##   Party.fctr.All.X.ica.rcv.glmnet.err
## 1                                TRUE
## 2                                TRUE
##   Party.fctr.All.X.ica.rcv.glmnet.err.abs
## 1                               0.6239498
## 2                               0.5577018
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet
## 1                                          D
## 2                                          D
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## 1                                       0.4240877
## 2                                       0.6347045
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.is.acc
## 1                                             FALSE
## 2                                             FALSE
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.err
## 1                                           TRUE
## 2                                           TRUE
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.err.abs
## 1                                          0.5759123
## 2                                          0.3652955
##   Party.fctr.Ensemble.auto.2..rcv.glmnet.prob
## 1                                   0.2971741
## 2                                   0.6419380
##   Party.fctr.Ensemble.auto.2..rcv.glmnet
## 1                                      D
## 2                                      D
##   Party.fctr.Ensemble.auto.2..rcv.glmnet.err
## 1                                       TRUE
## 2                                       TRUE
##   Party.fctr.Ensemble.auto.2..rcv.glmnet.err.abs
## 1                                      0.7028259
## 2                                      0.3580620
##   Party.fctr.Ensemble.auto.2..rcv.glmnet.is.acc
## 1                                         FALSE
## 2                                         FALSE
##   Party.fctr.Ensemble.auto.2..rcv.glmnet.accurate
## 1                                           FALSE
## 2                                           FALSE
##   Party.fctr.Ensemble.auto.2..rcv.glmnet.error .label
## 1                                 -0.352825878   3834
## 2                                 -0.008062009   3256
## [1] "Inaccurate: "
##   USER_ID Party.fctr Party.fctr.RFE.X.Inc..rcv.bagEarth
## 1    3895          R                                  D
## 2    2749          R                                  D
## 3    3212          R                                  D
## 4    1236          R                                  D
## 5    5499          R                                  D
## 6    4506          R                                  D
##   Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## 1                              0.03265932
## 2                              0.04387413
## 3                              0.05387724
## 4                              0.04304825
## 5                              0.06109203
## 6                              0.05701378
##   Party.fctr.RFE.X.Inc..rcv.bagEarth.is.acc
## 1                                     FALSE
## 2                                     FALSE
## 3                                     FALSE
## 4                                     FALSE
## 5                                     FALSE
## 6                                     FALSE
##   Party.fctr.RFE.X.Inc..rcv.bagEarth.err
## 1                                   TRUE
## 2                                   TRUE
## 3                                   TRUE
## 4                                   TRUE
## 5                                   TRUE
## 6                                   TRUE
##   Party.fctr.RFE.X.Inc..rcv.bagEarth.err.abs
## 1                                  0.9673407
## 2                                  0.9561259
## 3                                  0.9461228
## 4                                  0.9569518
## 5                                  0.9389080
## 6                                  0.9429862
##   Party.fctr.RFE.X..rcv.bagEarth Party.fctr.RFE.X..rcv.bagEarth.prob
## 1                              D                          0.03131226
## 2                              D                          0.04518027
## 3                              D                          0.08764815
## 4                              D                          0.03756575
## 5                              D                          0.06827835
## 6                              D                          0.06197281
##   Party.fctr.RFE.X..rcv.bagEarth.is.acc Party.fctr.RFE.X..rcv.bagEarth.err
## 1                                 FALSE                               TRUE
## 2                                 FALSE                               TRUE
## 3                                 FALSE                               TRUE
## 4                                 FALSE                               TRUE
## 5                                 FALSE                               TRUE
## 6                                 FALSE                               TRUE
##   Party.fctr.RFE.X..rcv.bagEarth.err.abs
## 1                              0.9686877
## 2                              0.9548197
## 3                              0.9123518
## 4                              0.9624342
## 5                              0.9317216
## 6                              0.9380272
##   Party.fctr.RFE.X.zv.pca.rcv.glmnet
## 1                                  D
## 2                                  D
## 3                                  D
## 4                                  D
## 5                                  D
## 6                                  D
##   Party.fctr.RFE.X.zv.pca.rcv.glmnet.prob
## 1                               0.0655629
## 2                               0.1378931
## 3                               0.1554305
## 4                               0.1441549
## 5                               0.1229141
## 6                               0.1167286
##   Party.fctr.RFE.X.zv.pca.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                     FALSE
## 3                                     FALSE
## 4                                     FALSE
## 5                                     FALSE
## 6                                     FALSE
##   Party.fctr.RFE.X.zv.pca.rcv.glmnet.err
## 1                                   TRUE
## 2                                   TRUE
## 3                                   TRUE
## 4                                   TRUE
## 5                                   TRUE
## 6                                   TRUE
##   Party.fctr.RFE.X.zv.pca.rcv.glmnet.err.abs
## 1                                  0.9344371
## 2                                  0.8621069
## 3                                  0.8445695
## 4                                  0.8558451
## 5                                  0.8770859
## 6                                  0.8832714
##   Party.fctr.All.X.nzv.spatialSign.rcv.glmnet
## 1                                           D
## 2                                           D
## 3                                           D
## 4                                           D
## 5                                           D
## 6                                           D
##   Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## 1                                        0.1172416
## 2                                        0.1646924
## 3                                        0.1692520
## 4                                        0.1222990
## 5                                        0.1390787
## 6                                        0.1180787
##   Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.is.acc
## 1                                              FALSE
## 2                                              FALSE
## 3                                              FALSE
## 4                                              FALSE
## 5                                              FALSE
## 6                                              FALSE
##   Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.err
## 1                                            TRUE
## 2                                            TRUE
## 3                                            TRUE
## 4                                            TRUE
## 5                                            TRUE
## 6                                            TRUE
##   Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.err.abs
## 1                                           0.8827584
## 2                                           0.8353076
## 3                                           0.8307480
## 4                                           0.8777010
## 5                                           0.8609213
## 6                                           0.8819213
##   Party.fctr.All.X.spatialSign.rcv.glmnet
## 1                                       D
## 2                                       D
## 3                                       D
## 4                                       D
## 5                                       D
## 6                                       D
##   Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## 1                                   0.07604966
## 2                                   0.10793623
## 3                                   0.15114829
## 4                                   0.08077740
## 5                                   0.11924094
## 6                                   0.12222979
##   Party.fctr.All.X.spatialSign.rcv.glmnet.is.acc
## 1                                          FALSE
## 2                                          FALSE
## 3                                          FALSE
## 4                                          FALSE
## 5                                          FALSE
## 6                                          FALSE
##   Party.fctr.All.X.spatialSign.rcv.glmnet.err
## 1                                        TRUE
## 2                                        TRUE
## 3                                        TRUE
## 4                                        TRUE
## 5                                        TRUE
## 6                                        TRUE
##   Party.fctr.All.X.spatialSign.rcv.glmnet.err.abs
## 1                                       0.9239503
## 2                                       0.8920638
## 3                                       0.8488517
## 4                                       0.9192226
## 5                                       0.8807591
## 6                                       0.8777702
##   Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet
## 1                                           D
## 2                                           D
## 3                                           D
## 4                                           D
## 5                                           D
## 6                                           D
##   Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.prob
## 1                                        0.1074752
## 2                                        0.1658227
## 3                                        0.1685835
## 4                                        0.1231948
## 5                                        0.1402179
## 6                                        0.1190112
##   Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.is.acc
## 1                                              FALSE
## 2                                              FALSE
## 3                                              FALSE
## 4                                              FALSE
## 5                                              FALSE
## 6                                              FALSE
##   Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.err
## 1                                            TRUE
## 2                                            TRUE
## 3                                            TRUE
## 4                                            TRUE
## 5                                            TRUE
## 6                                            TRUE
##   Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.err.abs
## 1                                           0.8925248
## 2                                           0.8341773
## 3                                           0.8314165
## 4                                           0.8768052
## 5                                           0.8597821
## 6                                           0.8809888
##   Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet
## 1                                               D
## 2                                               D
## 3                                               D
## 4                                               D
## 5                                               D
## 6                                               D
##   Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.prob
## 1                                           0.09115331
## 2                                           0.09182390
## 3                                           0.10178459
## 4                                           0.09376318
## 5                                           0.09963366
## 6                                           0.08020393
##   Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.is.acc
## 1                                                  FALSE
## 2                                                  FALSE
## 3                                                  FALSE
## 4                                                  FALSE
## 5                                                  FALSE
## 6                                                  FALSE
##   Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.err
## 1                                                TRUE
## 2                                                TRUE
## 3                                                TRUE
## 4                                                TRUE
## 5                                                TRUE
## 6                                                TRUE
##   Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.err.abs
## 1                                               0.9088467
## 2                                               0.9081761
## 3                                               0.8982154
## 4                                               0.9062368
## 5                                               0.9003663
## 6                                               0.9197961
##   Party.fctr.RFE.X.spatialSign.rcv.glmnet
## 1                                       D
## 2                                       D
## 3                                       D
## 4                                       D
## 5                                       D
## 6                                       D
##   Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## 1                                   0.07198825
## 2                                   0.10855452
## 3                                   0.15047631
## 4                                   0.08095251
## 5                                   0.11982093
## 6                                   0.12233751
##   Party.fctr.RFE.X.spatialSign.rcv.glmnet.is.acc
## 1                                          FALSE
## 2                                          FALSE
## 3                                          FALSE
## 4                                          FALSE
## 5                                          FALSE
## 6                                          FALSE
##   Party.fctr.RFE.X.spatialSign.rcv.glmnet.err
## 1                                        TRUE
## 2                                        TRUE
## 3                                        TRUE
## 4                                        TRUE
## 5                                        TRUE
## 6                                        TRUE
##   Party.fctr.RFE.X.spatialSign.rcv.glmnet.err.abs
## 1                                       0.9280118
## 2                                       0.8914455
## 3                                       0.8495237
## 4                                       0.9190475
## 5                                       0.8801791
## 6                                       0.8776625
##   Party.fctr.All.X.nzv.rcv.glmnet Party.fctr.All.X.nzv.rcv.glmnet.prob
## 1                               D                            0.1183036
## 2                               D                            0.1380514
## 3                               D                            0.1554942
## 4                               D                            0.1327806
## 5                               D                            0.1240270
## 6                               D                            0.1090369
##   Party.fctr.All.X.nzv.rcv.glmnet.is.acc
## 1                                  FALSE
## 2                                  FALSE
## 3                                  FALSE
## 4                                  FALSE
## 5                                  FALSE
## 6                                  FALSE
##   Party.fctr.All.X.nzv.rcv.glmnet.err
## 1                                TRUE
## 2                                TRUE
## 3                                TRUE
## 4                                TRUE
## 5                                TRUE
## 6                                TRUE
##   Party.fctr.All.X.nzv.rcv.glmnet.err.abs Party.fctr.RFE.X.nzv.rcv.glmnet
## 1                               0.8816964                               D
## 2                               0.8619486                               D
## 3                               0.8445058                               D
## 4                               0.8672194                               D
## 5                               0.8759730                               D
## 6                               0.8909631                               D
##   Party.fctr.RFE.X.nzv.rcv.glmnet.prob
## 1                            0.1150356
## 2                            0.1384146
## 3                            0.1552284
## 4                            0.1333908
## 5                            0.1249767
## 6                            0.1096957
##   Party.fctr.RFE.X.nzv.rcv.glmnet.is.acc
## 1                                  FALSE
## 2                                  FALSE
## 3                                  FALSE
## 4                                  FALSE
## 5                                  FALSE
## 6                                  FALSE
##   Party.fctr.RFE.X.nzv.rcv.glmnet.err
## 1                                TRUE
## 2                                TRUE
## 3                                TRUE
## 4                                TRUE
## 5                                TRUE
## 6                                TRUE
##   Party.fctr.RFE.X.nzv.rcv.glmnet.err.abs
## 1                               0.8849644
## 2                               0.8615854
## 3                               0.8447716
## 4                               0.8666092
## 5                               0.8750233
## 6                               0.8903043
##   Party.fctr.All.X.expoTrans.rcv.glmnet
## 1                                     D
## 2                                     D
## 3                                     D
## 4                                     D
## 5                                     D
## 6                                     D
##   Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## 1                                 0.06917972
## 2                                 0.07989952
## 3                                 0.13940931
## 4                                 0.08352619
## 5                                 0.11176987
## 6                                 0.11492926
##   Party.fctr.All.X.expoTrans.rcv.glmnet.is.acc
## 1                                        FALSE
## 2                                        FALSE
## 3                                        FALSE
## 4                                        FALSE
## 5                                        FALSE
## 6                                        FALSE
##   Party.fctr.All.X.expoTrans.rcv.glmnet.err
## 1                                      TRUE
## 2                                      TRUE
## 3                                      TRUE
## 4                                      TRUE
## 5                                      TRUE
## 6                                      TRUE
##   Party.fctr.All.X.expoTrans.rcv.glmnet.err.abs
## 1                                     0.9308203
## 2                                     0.9201005
## 3                                     0.8605907
## 4                                     0.9164738
## 5                                     0.8882301
## 6                                     0.8850707
##   Party.fctr.RFE.X.expoTrans.rcv.glmnet
## 1                                     D
## 2                                     D
## 3                                     D
## 4                                     D
## 5                                     D
## 6                                     D
##   Party.fctr.RFE.X.expoTrans.rcv.glmnet.prob
## 1                                 0.06917972
## 2                                 0.07989952
## 3                                 0.13940931
## 4                                 0.08352619
## 5                                 0.11176987
## 6                                 0.11492926
##   Party.fctr.RFE.X.expoTrans.rcv.glmnet.is.acc
## 1                                        FALSE
## 2                                        FALSE
## 3                                        FALSE
## 4                                        FALSE
## 5                                        FALSE
## 6                                        FALSE
##   Party.fctr.RFE.X.expoTrans.rcv.glmnet.err
## 1                                      TRUE
## 2                                      TRUE
## 3                                      TRUE
## 4                                      TRUE
## 5                                      TRUE
## 6                                      TRUE
##   Party.fctr.RFE.X.expoTrans.rcv.glmnet.err.abs
## 1                                     0.9308203
## 2                                     0.9201005
## 3                                     0.8605907
## 4                                     0.9164738
## 5                                     0.8882301
## 6                                     0.8850707
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet
## 1                                      D
## 2                                      D
## 3                                      D
## 4                                      D
## 5                                      D
## 6                                      D
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## 1                                  0.06922470
## 2                                  0.07993341
## 3                                  0.13945360
## 4                                  0.08355202
## 5                                  0.11181809
## 6                                  0.11498550
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.is.acc
## 1                                         FALSE
## 2                                         FALSE
## 3                                         FALSE
## 4                                         FALSE
## 5                                         FALSE
## 6                                         FALSE
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.err
## 1                                       TRUE
## 2                                       TRUE
## 3                                       TRUE
## 4                                       TRUE
## 5                                       TRUE
## 6                                       TRUE
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.err.abs
## 1                                      0.9307753
## 2                                      0.9200666
## 3                                      0.8605464
## 4                                      0.9164480
## 5                                      0.8881819
## 6                                      0.8850145
##   Party.fctr.RFE.X.YeoJohnson.rcv.glmnet
## 1                                      D
## 2                                      D
## 3                                      D
## 4                                      D
## 5                                      D
## 6                                      D
##   Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## 1                                  0.06922470
## 2                                  0.07993341
## 3                                  0.13945360
## 4                                  0.08355202
## 5                                  0.11181809
## 6                                  0.11498550
##   Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.is.acc
## 1                                         FALSE
## 2                                         FALSE
## 3                                         FALSE
## 4                                         FALSE
## 5                                         FALSE
## 6                                         FALSE
##   Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.err
## 1                                       TRUE
## 2                                       TRUE
## 3                                       TRUE
## 4                                       TRUE
## 5                                       TRUE
## 6                                       TRUE
##   Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.err.abs
## 1                                      0.9307753
## 2                                      0.9200666
## 3                                      0.8605464
## 4                                      0.9164480
## 5                                      0.8881819
## 6                                      0.8850145
##   Party.fctr.RFE.X..rcv.rpart Party.fctr.RFE.X..rcv.rpart.prob
## 1                           D                        0.1327078
## 2                           D                        0.1327078
## 3                           D                        0.1327078
## 4                           D                        0.1327078
## 5                           D                        0.1327078
## 6                           D                        0.1327078
##   Party.fctr.RFE.X..rcv.rpart.is.acc Party.fctr.RFE.X..rcv.rpart.err
## 1                              FALSE                            TRUE
## 2                              FALSE                            TRUE
## 3                              FALSE                            TRUE
## 4                              FALSE                            TRUE
## 5                              FALSE                            TRUE
## 6                              FALSE                            TRUE
##   Party.fctr.RFE.X..rcv.rpart.err.abs Party.fctr.RFE.X..rcv.glmnet
## 1                           0.8672922                            D
## 2                           0.8672922                            D
## 3                           0.8672922                            D
## 4                           0.8672922                            D
## 5                           0.8672922                            D
## 6                           0.8672922                            D
##   Party.fctr.RFE.X..rcv.glmnet.prob Party.fctr.RFE.X..rcv.glmnet.is.acc
## 1                        0.06723964                               FALSE
## 2                        0.08013563                               FALSE
## 3                        0.13987552                               FALSE
## 4                        0.08397483                               FALSE
## 5                        0.11128011                               FALSE
## 6                        0.11489050                               FALSE
##   Party.fctr.RFE.X..rcv.glmnet.err Party.fctr.RFE.X..rcv.glmnet.err.abs
## 1                             TRUE                            0.9327604
## 2                             TRUE                            0.9198644
## 3                             TRUE                            0.8601245
## 4                             TRUE                            0.9160252
## 5                             TRUE                            0.8887199
## 6                             TRUE                            0.8851095
##   Party.fctr.All.X.conditionalX.rcv.glmnet
## 1                                        D
## 2                                        D
## 3                                        D
## 4                                        D
## 5                                        D
## 6                                        D
##   Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## 1                                    0.06723964
## 2                                    0.08013563
## 3                                    0.13987552
## 4                                    0.08397483
## 5                                    0.11128011
## 6                                    0.11489050
##   Party.fctr.All.X.conditionalX.rcv.glmnet.is.acc
## 1                                           FALSE
## 2                                           FALSE
## 3                                           FALSE
## 4                                           FALSE
## 5                                           FALSE
## 6                                           FALSE
##   Party.fctr.All.X.conditionalX.rcv.glmnet.err
## 1                                         TRUE
## 2                                         TRUE
## 3                                         TRUE
## 4                                         TRUE
## 5                                         TRUE
## 6                                         TRUE
##   Party.fctr.All.X.conditionalX.rcv.glmnet.err.abs
## 1                                        0.9327604
## 2                                        0.9198644
## 3                                        0.8601245
## 4                                        0.9160252
## 5                                        0.8887199
## 6                                        0.8851095
##   Party.fctr.All.X..rcv.glmnet Party.fctr.All.X..rcv.glmnet.prob
## 1                            D                        0.06723964
## 2                            D                        0.08013563
## 3                            D                        0.13987552
## 4                            D                        0.08397483
## 5                            D                        0.11128011
## 6                            D                        0.11489050
##   Party.fctr.All.X..rcv.glmnet.is.acc Party.fctr.All.X..rcv.glmnet.err
## 1                               FALSE                             TRUE
## 2                               FALSE                             TRUE
## 3                               FALSE                             TRUE
## 4                               FALSE                             TRUE
## 5                               FALSE                             TRUE
## 6                               FALSE                             TRUE
##   Party.fctr.All.X..rcv.glmnet.err.abs Party.fctr.Low.cor.X..rcv.glmnet
## 1                            0.9327604                                D
## 2                            0.9198644                                D
## 3                            0.8601245                                D
## 4                            0.9160252                                D
## 5                            0.8887199                                D
## 6                            0.8851095                                D
##   Party.fctr.Low.cor.X..rcv.glmnet.prob
## 1                            0.06723964
## 2                            0.08013563
## 3                            0.13987552
## 4                            0.08397483
## 5                            0.11128011
## 6                            0.11489050
##   Party.fctr.Low.cor.X..rcv.glmnet.is.acc
## 1                                   FALSE
## 2                                   FALSE
## 3                                   FALSE
## 4                                   FALSE
## 5                                   FALSE
## 6                                   FALSE
##   Party.fctr.Low.cor.X..rcv.glmnet.err
## 1                                 TRUE
## 2                                 TRUE
## 3                                 TRUE
## 4                                 TRUE
## 5                                 TRUE
## 6                                 TRUE
##   Party.fctr.Low.cor.X..rcv.glmnet.err.abs
## 1                                0.9327604
## 2                                0.9198644
## 3                                0.8601245
## 4                                0.9160252
## 5                                0.8887199
## 6                                0.8851095
##   Party.fctr.RFE.X.conditionalX.rcv.glmnet
## 1                                        D
## 2                                        D
## 3                                        D
## 4                                        D
## 5                                        D
## 6                                        D
##   Party.fctr.RFE.X.conditionalX.rcv.glmnet.prob
## 1                                    0.06723964
## 2                                    0.08013563
## 3                                    0.13987552
## 4                                    0.08397483
## 5                                    0.11128011
## 6                                    0.11489050
##   Party.fctr.RFE.X.conditionalX.rcv.glmnet.is.acc
## 1                                           FALSE
## 2                                           FALSE
## 3                                           FALSE
## 4                                           FALSE
## 5                                           FALSE
## 6                                           FALSE
##   Party.fctr.RFE.X.conditionalX.rcv.glmnet.err
## 1                                         TRUE
## 2                                         TRUE
## 3                                         TRUE
## 4                                         TRUE
## 5                                         TRUE
## 6                                         TRUE
##   Party.fctr.RFE.X.conditionalX.rcv.glmnet.err.abs
## 1                                        0.9327604
## 2                                        0.9198644
## 3                                        0.8601245
## 4                                        0.9160252
## 5                                        0.8887199
## 6                                        0.8851095
##   Party.fctr.All.X.zv.rcv.glmnet Party.fctr.All.X.zv.rcv.glmnet.prob
## 1                              D                          0.06723964
## 2                              D                          0.08013563
## 3                              D                          0.13987552
## 4                              D                          0.08397483
## 5                              D                          0.11128011
## 6                              D                          0.11489050
##   Party.fctr.All.X.zv.rcv.glmnet.is.acc Party.fctr.All.X.zv.rcv.glmnet.err
## 1                                 FALSE                               TRUE
## 2                                 FALSE                               TRUE
## 3                                 FALSE                               TRUE
## 4                                 FALSE                               TRUE
## 5                                 FALSE                               TRUE
## 6                                 FALSE                               TRUE
##   Party.fctr.All.X.zv.rcv.glmnet.err.abs Party.fctr.RFE.X.zv.rcv.glmnet
## 1                              0.9327604                              D
## 2                              0.9198644                              D
## 3                              0.8601245                              D
## 4                              0.9160252                              D
## 5                              0.8887199                              D
## 6                              0.8851095                              D
##   Party.fctr.RFE.X.zv.rcv.glmnet.prob
## 1                          0.06723964
## 2                          0.08013563
## 3                          0.13987552
## 4                          0.08397483
## 5                          0.11128011
## 6                          0.11489050
##   Party.fctr.RFE.X.zv.rcv.glmnet.is.acc Party.fctr.RFE.X.zv.rcv.glmnet.err
## 1                                 FALSE                               TRUE
## 2                                 FALSE                               TRUE
## 3                                 FALSE                               TRUE
## 4                                 FALSE                               TRUE
## 5                                 FALSE                               TRUE
## 6                                 FALSE                               TRUE
##   Party.fctr.RFE.X.zv.rcv.glmnet.err.abs Party.fctr.RFE.X.scale.rcv.glmnet
## 1                              0.9327604                                 D
## 2                              0.9198644                                 D
## 3                              0.8601245                                 D
## 4                              0.9160252                                 D
## 5                              0.8887199                                 D
## 6                              0.8851095                                 D
##   Party.fctr.RFE.X.scale.rcv.glmnet.prob
## 1                             0.06723964
## 2                             0.08013563
## 3                             0.13987552
## 4                             0.08397483
## 5                             0.11128011
## 6                             0.11489050
##   Party.fctr.RFE.X.scale.rcv.glmnet.is.acc
## 1                                    FALSE
## 2                                    FALSE
## 3                                    FALSE
## 4                                    FALSE
## 5                                    FALSE
## 6                                    FALSE
##   Party.fctr.RFE.X.scale.rcv.glmnet.err
## 1                                  TRUE
## 2                                  TRUE
## 3                                  TRUE
## 4                                  TRUE
## 5                                  TRUE
## 6                                  TRUE
##   Party.fctr.RFE.X.scale.rcv.glmnet.err.abs
## 1                                 0.9327604
## 2                                 0.9198644
## 3                                 0.8601245
## 4                                 0.9160252
## 5                                 0.8887199
## 6                                 0.8851095
##   Party.fctr.RFE.X.center.rcv.glmnet
## 1                                  D
## 2                                  D
## 3                                  D
## 4                                  D
## 5                                  D
## 6                                  D
##   Party.fctr.RFE.X.center.rcv.glmnet.prob
## 1                              0.06723964
## 2                              0.08013563
## 3                              0.13987552
## 4                              0.08397483
## 5                              0.11128011
## 6                              0.11489050
##   Party.fctr.RFE.X.center.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                     FALSE
## 3                                     FALSE
## 4                                     FALSE
## 5                                     FALSE
## 6                                     FALSE
##   Party.fctr.RFE.X.center.rcv.glmnet.err
## 1                                   TRUE
## 2                                   TRUE
## 3                                   TRUE
## 4                                   TRUE
## 5                                   TRUE
## 6                                   TRUE
##   Party.fctr.RFE.X.center.rcv.glmnet.err.abs
## 1                                  0.9327604
## 2                                  0.9198644
## 3                                  0.8601245
## 4                                  0.9160252
## 5                                  0.8887199
## 6                                  0.8851095
##   Party.fctr.All.X.scale.rcv.glmnet Party.fctr.All.X.scale.rcv.glmnet.prob
## 1                                 D                             0.06723964
## 2                                 D                             0.08013563
## 3                                 D                             0.13987552
## 4                                 D                             0.08397483
## 5                                 D                             0.11128011
## 6                                 D                             0.11489050
##   Party.fctr.All.X.scale.rcv.glmnet.is.acc
## 1                                    FALSE
## 2                                    FALSE
## 3                                    FALSE
## 4                                    FALSE
## 5                                    FALSE
## 6                                    FALSE
##   Party.fctr.All.X.scale.rcv.glmnet.err
## 1                                  TRUE
## 2                                  TRUE
## 3                                  TRUE
## 4                                  TRUE
## 5                                  TRUE
## 6                                  TRUE
##   Party.fctr.All.X.scale.rcv.glmnet.err.abs
## 1                                 0.9327604
## 2                                 0.9198644
## 3                                 0.8601245
## 4                                 0.9160252
## 5                                 0.8887199
## 6                                 0.8851095
##   Party.fctr.All.X.center.rcv.glmnet
## 1                                  D
## 2                                  D
## 3                                  D
## 4                                  D
## 5                                  D
## 6                                  D
##   Party.fctr.All.X.center.rcv.glmnet.prob
## 1                              0.06723964
## 2                              0.08013563
## 3                              0.13987552
## 4                              0.08397483
## 5                              0.11128011
## 6                              0.11489050
##   Party.fctr.All.X.center.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                     FALSE
## 3                                     FALSE
## 4                                     FALSE
## 5                                     FALSE
## 6                                     FALSE
##   Party.fctr.All.X.center.rcv.glmnet.err
## 1                                   TRUE
## 2                                   TRUE
## 3                                   TRUE
## 4                                   TRUE
## 5                                   TRUE
## 6                                   TRUE
##   Party.fctr.All.X.center.rcv.glmnet.err.abs
## 1                                  0.9327604
## 2                                  0.9198644
## 3                                  0.8601245
## 4                                  0.9160252
## 5                                  0.8887199
## 6                                  0.8851095
##   Party.fctr.RFE.X.range.rcv.glmnet Party.fctr.RFE.X.range.rcv.glmnet.prob
## 1                                 D                             0.06723964
## 2                                 D                             0.08013563
## 3                                 D                             0.13987552
## 4                                 D                             0.08397483
## 5                                 D                             0.11128011
## 6                                 D                             0.11489050
##   Party.fctr.RFE.X.range.rcv.glmnet.is.acc
## 1                                    FALSE
## 2                                    FALSE
## 3                                    FALSE
## 4                                    FALSE
## 5                                    FALSE
## 6                                    FALSE
##   Party.fctr.RFE.X.range.rcv.glmnet.err
## 1                                  TRUE
## 2                                  TRUE
## 3                                  TRUE
## 4                                  TRUE
## 5                                  TRUE
## 6                                  TRUE
##   Party.fctr.RFE.X.range.rcv.glmnet.err.abs
## 1                                 0.9327604
## 2                                 0.9198644
## 3                                 0.8601245
## 4                                 0.9160252
## 5                                 0.8887199
## 6                                 0.8851095
##   Party.fctr.RFE.X.BoxCox.rcv.glmnet
## 1                                  D
## 2                                  D
## 3                                  D
## 4                                  D
## 5                                  D
## 6                                  D
##   Party.fctr.RFE.X.BoxCox.rcv.glmnet.prob
## 1                              0.06723964
## 2                              0.08013563
## 3                              0.13987552
## 4                              0.08397483
## 5                              0.11128011
## 6                              0.11489050
##   Party.fctr.RFE.X.BoxCox.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                     FALSE
## 3                                     FALSE
## 4                                     FALSE
## 5                                     FALSE
## 6                                     FALSE
##   Party.fctr.RFE.X.BoxCox.rcv.glmnet.err
## 1                                   TRUE
## 2                                   TRUE
## 3                                   TRUE
## 4                                   TRUE
## 5                                   TRUE
## 6                                   TRUE
##   Party.fctr.RFE.X.BoxCox.rcv.glmnet.err.abs
## 1                                  0.9327604
## 2                                  0.9198644
## 3                                  0.8601245
## 4                                  0.9160252
## 5                                  0.8887199
## 6                                  0.8851095
##   Party.fctr.All.X.range.rcv.glmnet Party.fctr.All.X.range.rcv.glmnet.prob
## 1                                 D                             0.06723964
## 2                                 D                             0.08013563
## 3                                 D                             0.13987552
## 4                                 D                             0.08397483
## 5                                 D                             0.11128011
## 6                                 D                             0.11489050
##   Party.fctr.All.X.range.rcv.glmnet.is.acc
## 1                                    FALSE
## 2                                    FALSE
## 3                                    FALSE
## 4                                    FALSE
## 5                                    FALSE
## 6                                    FALSE
##   Party.fctr.All.X.range.rcv.glmnet.err
## 1                                  TRUE
## 2                                  TRUE
## 3                                  TRUE
## 4                                  TRUE
## 5                                  TRUE
## 6                                  TRUE
##   Party.fctr.All.X.range.rcv.glmnet.err.abs
## 1                                 0.9327604
## 2                                 0.9198644
## 3                                 0.8601245
## 4                                 0.9160252
## 5                                 0.8887199
## 6                                 0.8851095
##   Party.fctr.All.X.BoxCox.rcv.glmnet
## 1                                  D
## 2                                  D
## 3                                  D
## 4                                  D
## 5                                  D
## 6                                  D
##   Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## 1                              0.06723964
## 2                              0.08013563
## 3                              0.13987552
## 4                              0.08397483
## 5                              0.11128011
## 6                              0.11489050
##   Party.fctr.All.X.BoxCox.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                     FALSE
## 3                                     FALSE
## 4                                     FALSE
## 5                                     FALSE
## 6                                     FALSE
##   Party.fctr.All.X.BoxCox.rcv.glmnet.err
## 1                                   TRUE
## 2                                   TRUE
## 3                                   TRUE
## 4                                   TRUE
## 5                                   TRUE
## 6                                   TRUE
##   Party.fctr.All.X.BoxCox.rcv.glmnet.err.abs
## 1                                  0.9327604
## 2                                  0.9198644
## 3                                  0.8601245
## 4                                  0.9160252
## 5                                  0.8887199
## 6                                  0.8851095
##   Party.fctr.RFE.X.center.scale.rcv.glmnet
## 1                                        D
## 2                                        D
## 3                                        D
## 4                                        D
## 5                                        D
## 6                                        D
##   Party.fctr.RFE.X.center.scale.rcv.glmnet.prob
## 1                                    0.06723964
## 2                                    0.08013563
## 3                                    0.13987552
## 4                                    0.08397483
## 5                                    0.11128011
## 6                                    0.11489050
##   Party.fctr.RFE.X.center.scale.rcv.glmnet.is.acc
## 1                                           FALSE
## 2                                           FALSE
## 3                                           FALSE
## 4                                           FALSE
## 5                                           FALSE
## 6                                           FALSE
##   Party.fctr.RFE.X.center.scale.rcv.glmnet.err
## 1                                         TRUE
## 2                                         TRUE
## 3                                         TRUE
## 4                                         TRUE
## 5                                         TRUE
## 6                                         TRUE
##   Party.fctr.RFE.X.center.scale.rcv.glmnet.err.abs
## 1                                        0.9327604
## 2                                        0.9198644
## 3                                        0.8601245
## 4                                        0.9160252
## 5                                        0.8887199
## 6                                        0.8851095
##   Party.fctr.All.X.center.scale.rcv.glmnet
## 1                                        D
## 2                                        D
## 3                                        D
## 4                                        D
## 5                                        D
## 6                                        D
##   Party.fctr.All.X.center.scale.rcv.glmnet.prob
## 1                                    0.06723964
## 2                                    0.08013563
## 3                                    0.13987552
## 4                                    0.08397483
## 5                                    0.11128011
## 6                                    0.11489050
##   Party.fctr.All.X.center.scale.rcv.glmnet.is.acc
## 1                                           FALSE
## 2                                           FALSE
## 3                                           FALSE
## 4                                           FALSE
## 5                                           FALSE
## 6                                           FALSE
##   Party.fctr.All.X.center.scale.rcv.glmnet.err
## 1                                         TRUE
## 2                                         TRUE
## 3                                         TRUE
## 4                                         TRUE
## 5                                         TRUE
## 6                                         TRUE
##   Party.fctr.All.X.center.scale.rcv.glmnet.err.abs
## 1                                        0.9327604
## 2                                        0.9198644
## 3                                        0.8601245
## 4                                        0.9160252
## 5                                        0.8887199
## 6                                        0.8851095
##   Party.fctr.All.X.zv.pca.rcv.glmnet
## 1                                  D
## 2                                  D
## 3                                  D
## 4                                  D
## 5                                  D
## 6                                  D
##   Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## 1                              0.08264309
## 2                              0.12947154
## 3                              0.15908798
## 4                              0.12887750
## 5                              0.14861125
## 6                              0.13156723
##   Party.fctr.All.X.zv.pca.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                     FALSE
## 3                                     FALSE
## 4                                     FALSE
## 5                                     FALSE
## 6                                     FALSE
##   Party.fctr.All.X.zv.pca.rcv.glmnet.err
## 1                                   TRUE
## 2                                   TRUE
## 3                                   TRUE
## 4                                   TRUE
## 5                                   TRUE
## 6                                   TRUE
##   Party.fctr.All.X.zv.pca.rcv.glmnet.err.abs Party.fctr.RFE.X..rcv.gbm
## 1                                  0.9173569                         D
## 2                                  0.8705285                         D
## 3                                  0.8409120                         D
## 4                                  0.8711225                         D
## 5                                  0.8513888                         D
## 6                                  0.8684328                         D
##   Party.fctr.RFE.X..rcv.gbm.prob Party.fctr.RFE.X..rcv.gbm.is.acc
## 1                     0.06666800                            FALSE
## 2                     0.08682857                            FALSE
## 3                     0.11393964                            FALSE
## 4                     0.08547744                            FALSE
## 5                     0.10084706                            FALSE
## 6                     0.10726729                            FALSE
##   Party.fctr.RFE.X..rcv.gbm.err Party.fctr.RFE.X..rcv.gbm.err.abs
## 1                          TRUE                         0.9333320
## 2                          TRUE                         0.9131714
## 3                          TRUE                         0.8860604
## 4                          TRUE                         0.9145226
## 5                          TRUE                         0.8991529
## 6                          TRUE                         0.8927327
##   Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet
## 1                                               D
## 2                                               D
## 3                                               D
## 4                                               D
## 5                                               D
## 6                                               D
##   Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.prob
## 1                                            0.1575228
## 2                                            0.2139471
## 3                                            0.1543864
## 4                                            0.1654979
## 5                                            0.1819335
## 6                                            0.1487200
##   Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.is.acc
## 1                                                  FALSE
## 2                                                  FALSE
## 3                                                  FALSE
## 4                                                  FALSE
## 5                                                  FALSE
## 6                                                  FALSE
##   Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.err
## 1                                                TRUE
## 2                                                TRUE
## 3                                                TRUE
## 4                                                TRUE
## 5                                                TRUE
## 6                                                TRUE
##   Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.err.abs
## 1                                               0.8424772
## 2                                               0.7860529
## 3                                               0.8456136
## 4                                               0.8345021
## 5                                               0.8180665
## 6                                               0.8512800
##   Party.fctr.RFE.X..rcv.earth Party.fctr.RFE.X..rcv.earth.prob
## 1                           D                       0.04619123
## 2                           D                       0.03582395
## 3                           D                       0.08181182
## 4                           D                       0.04754454
## 5                           D                       0.09495574
## 6                           D                       0.09127157
##   Party.fctr.RFE.X..rcv.earth.is.acc Party.fctr.RFE.X..rcv.earth.err
## 1                              FALSE                            TRUE
## 2                              FALSE                            TRUE
## 3                              FALSE                            TRUE
## 4                              FALSE                            TRUE
## 5                              FALSE                            TRUE
## 6                              FALSE                            TRUE
##   Party.fctr.RFE.X..rcv.earth.err.abs Party.fctr.RFE.X..rcv.glm
## 1                           0.9538088                         D
## 2                           0.9641761                         D
## 3                           0.9181882                         D
## 4                           0.9524555                         D
## 5                           0.9050443                         D
## 6                           0.9087284                         D
##   Party.fctr.RFE.X..rcv.glm.prob Party.fctr.RFE.X..rcv.glm.is.acc
## 1                     0.06644046                            FALSE
## 2                     0.04991006                            FALSE
## 3                     0.09540911                            FALSE
## 4                     0.01953030                            FALSE
## 5                     0.04983503                            FALSE
## 6                     0.06218681                            FALSE
##   Party.fctr.RFE.X..rcv.glm.err Party.fctr.RFE.X..rcv.glm.err.abs
## 1                          TRUE                         0.9335595
## 2                          TRUE                         0.9500899
## 3                          TRUE                         0.9045909
## 4                          TRUE                         0.9804697
## 5                          TRUE                         0.9501650
## 6                          TRUE                         0.9378132
##   Party.fctr.All.X..rcv.glm Party.fctr.All.X..rcv.glm.prob
## 1                         D                     0.08520718
## 2                         D                     0.04882001
## 3                         D                     0.09593901
## 4                         D                     0.01900093
## 5                         D                     0.04767510
## 6                         D                     0.05945993
##   Party.fctr.All.X..rcv.glm.is.acc Party.fctr.All.X..rcv.glm.err
## 1                            FALSE                          TRUE
## 2                            FALSE                          TRUE
## 3                            FALSE                          TRUE
## 4                            FALSE                          TRUE
## 5                            FALSE                          TRUE
## 6                            FALSE                          TRUE
##   Party.fctr.All.X..rcv.glm.err.abs Party.fctr.RFE.X..rcv.rf
## 1                         0.9147928                        D
## 2                         0.9511800                        D
## 3                         0.9040610                        D
## 4                         0.9809991                        D
## 5                         0.9523249                        D
## 6                         0.9405401                        D
##   Party.fctr.RFE.X..rcv.rf.prob Party.fctr.RFE.X..rcv.rf.is.acc
## 1                         0.144                           FALSE
## 2                         0.162                           FALSE
## 3                         0.054                           FALSE
## 4                         0.130                           FALSE
## 5                         0.150                           FALSE
## 6                         0.122                           FALSE
##   Party.fctr.RFE.X..rcv.rf.err Party.fctr.RFE.X..rcv.rf.err.abs
## 1                         TRUE                            0.856
## 2                         TRUE                            0.838
## 3                         TRUE                            0.946
## 4                         TRUE                            0.870
## 5                         TRUE                            0.850
## 6                         TRUE                            0.878
##   Party.fctr.RFE.X..rcv.avNNet Party.fctr.RFE.X..rcv.avNNet.prob
## 1                            D                         0.0839713
## 2                            D                         0.1699379
## 3                            D                         0.0844142
## 4                            D                         0.0839713
## 5                            D                         0.1370221
## 6                            D                         0.0839713
##   Party.fctr.RFE.X..rcv.avNNet.is.acc Party.fctr.RFE.X..rcv.avNNet.err
## 1                               FALSE                             TRUE
## 2                               FALSE                             TRUE
## 3                               FALSE                             TRUE
## 4                               FALSE                             TRUE
## 5                               FALSE                             TRUE
## 6                               FALSE                             TRUE
##   Party.fctr.RFE.X..rcv.avNNet.err.abs Party.fctr.RFE.X..rcv.nnet
## 1                            0.9160287                          D
## 2                            0.8300621                          D
## 3                            0.9155858                          D
## 4                            0.9160287                          D
## 5                            0.8629779                          D
## 6                            0.9160287                          D
##   Party.fctr.RFE.X..rcv.nnet.prob Party.fctr.RFE.X..rcv.nnet.is.acc
## 1                       0.1826738                             FALSE
## 2                       0.1828281                             FALSE
## 3                       0.1829701                             FALSE
## 4                       0.1826730                             FALSE
## 5                       0.1826785                             FALSE
## 6                       0.1826739                             FALSE
##   Party.fctr.RFE.X..rcv.nnet.err Party.fctr.RFE.X..rcv.nnet.err.abs
## 1                           TRUE                          0.8173262
## 2                           TRUE                          0.8171719
## 3                           TRUE                          0.8170299
## 4                           TRUE                          0.8173270
## 5                           TRUE                          0.8173215
## 6                           TRUE                          0.8173261
##   Party.fctr.RFE.X.ica.rcv.glmnet Party.fctr.RFE.X.ica.rcv.glmnet.prob
## 1                               D                            0.4367883
## 2                               D                            0.5190807
## 3                               D                            0.4916762
## 4                               D                            0.3743749
## 5                               D                            0.4718801
## 6                               D                            0.4148080
##   Party.fctr.RFE.X.ica.rcv.glmnet.is.acc
## 1                                  FALSE
## 2                                  FALSE
## 3                                  FALSE
## 4                                  FALSE
## 5                                  FALSE
## 6                                  FALSE
##   Party.fctr.RFE.X.ica.rcv.glmnet.err
## 1                                TRUE
## 2                                TRUE
## 3                                TRUE
## 4                                TRUE
## 5                                TRUE
## 6                                TRUE
##   Party.fctr.RFE.X.ica.rcv.glmnet.err.abs Party.fctr.All.X.ica.rcv.glmnet
## 1                               0.5632117                               D
## 2                               0.4809193                               D
## 3                               0.5083238                               D
## 4                               0.6256251                               D
## 5                               0.5281199                               D
## 6                               0.5851920                               D
##   Party.fctr.All.X.ica.rcv.glmnet.prob
## 1                            0.4331468
## 2                            0.5249060
## 3                            0.4964380
## 4                            0.3725389
## 5                            0.4730504
## 6                            0.4146711
##   Party.fctr.All.X.ica.rcv.glmnet.is.acc
## 1                                  FALSE
## 2                                  FALSE
## 3                                  FALSE
## 4                                  FALSE
## 5                                  FALSE
## 6                                  FALSE
##   Party.fctr.All.X.ica.rcv.glmnet.err
## 1                                TRUE
## 2                                TRUE
## 3                                TRUE
## 4                                TRUE
## 5                                TRUE
## 6                                TRUE
##   Party.fctr.All.X.ica.rcv.glmnet.err.abs
## 1                               0.5668532
## 2                               0.4750940
## 3                               0.5035620
## 4                               0.6274611
## 5                               0.5269496
## 6                               0.5853289
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet
## 1                                          D
## 2                                          D
## 3                                          D
## 4                                          D
## 5                                          D
## 6                                          D
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## 1                                      0.15979667
## 2                                      0.07791594
## 3                                      0.07094513
## 4                                      0.13715343
## 5                                      0.18800585
## 6                                      0.13952406
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.is.acc
## 1                                             FALSE
## 2                                             FALSE
## 3                                             FALSE
## 4                                             FALSE
## 5                                             FALSE
## 6                                             FALSE
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.err
## 1                                           TRUE
## 2                                           TRUE
## 3                                           TRUE
## 4                                           TRUE
## 5                                           TRUE
## 6                                           TRUE
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.err.abs
## 1                                          0.8402033
## 2                                          0.9220841
## 3                                          0.9290549
## 4                                          0.8628466
## 5                                          0.8119942
## 6                                          0.8604759
##   Party.fctr.Ensemble.auto.2..rcv.glmnet.prob
## 1                                  0.07208907
## 2                                  0.07292973
## 3                                  0.07778309
## 4                                  0.07826192
## 5                                  0.08157876
## 6                                  0.08223478
##   Party.fctr.Ensemble.auto.2..rcv.glmnet
## 1                                      D
## 2                                      D
## 3                                      D
## 4                                      D
## 5                                      D
## 6                                      D
##   Party.fctr.Ensemble.auto.2..rcv.glmnet.err
## 1                                       TRUE
## 2                                       TRUE
## 3                                       TRUE
## 4                                       TRUE
## 5                                       TRUE
## 6                                       TRUE
##   Party.fctr.Ensemble.auto.2..rcv.glmnet.err.abs
## 1                                      0.9279109
## 2                                      0.9270703
## 3                                      0.9222169
## 4                                      0.9217381
## 5                                      0.9184212
## 6                                      0.9177652
##   Party.fctr.Ensemble.auto.2..rcv.glmnet.is.acc
## 1                                         FALSE
## 2                                         FALSE
## 3                                         FALSE
## 4                                         FALSE
## 5                                         FALSE
## 6                                         FALSE
##   Party.fctr.Ensemble.auto.2..rcv.glmnet.accurate
## 1                                           FALSE
## 2                                           FALSE
## 3                                           FALSE
## 4                                           FALSE
## 5                                           FALSE
## 6                                           FALSE
##   Party.fctr.Ensemble.auto.2..rcv.glmnet.error
## 1                                   -0.5779109
## 2                                   -0.5770703
## 3                                   -0.5722169
## 4                                   -0.5717381
## 5                                   -0.5684212
## 6                                   -0.5677652
##     USER_ID Party.fctr Party.fctr.RFE.X.Inc..rcv.bagEarth
## 31     6245          R                                  D
## 262     290          R                                  D
## 267    5601          R                                  D
## 288    5356          R                                  D
## 327     392          R                                  D
## 360     616          R                                  D
##     Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## 31                                0.1190122
## 262                               0.5245367
## 267                               0.5318466
## 288                               0.5399520
## 327                               0.5706573
## 360                               0.5983588
##     Party.fctr.RFE.X.Inc..rcv.bagEarth.is.acc
## 31                                      FALSE
## 262                                     FALSE
## 267                                     FALSE
## 288                                     FALSE
## 327                                     FALSE
## 360                                     FALSE
##     Party.fctr.RFE.X.Inc..rcv.bagEarth.err
## 31                                    TRUE
## 262                                   TRUE
## 267                                   TRUE
## 288                                   TRUE
## 327                                   TRUE
## 360                                   TRUE
##     Party.fctr.RFE.X.Inc..rcv.bagEarth.err.abs
## 31                                   0.8809878
## 262                                  0.4754633
## 267                                  0.4681534
## 288                                  0.4600480
## 327                                  0.4293427
## 360                                  0.4016412
##     Party.fctr.RFE.X..rcv.bagEarth Party.fctr.RFE.X..rcv.bagEarth.prob
## 31                               D                           0.2214017
## 262                              D                           0.4978424
## 267                              D                           0.4975819
## 288                              D                           0.5306029
## 327                              D                           0.5732592
## 360                              R                           0.6439439
##     Party.fctr.RFE.X..rcv.bagEarth.is.acc
## 31                                  FALSE
## 262                                 FALSE
## 267                                 FALSE
## 288                                 FALSE
## 327                                 FALSE
## 360                                  TRUE
##     Party.fctr.RFE.X..rcv.bagEarth.err
## 31                                TRUE
## 262                               TRUE
## 267                               TRUE
## 288                               TRUE
## 327                               TRUE
## 360                              FALSE
##     Party.fctr.RFE.X..rcv.bagEarth.err.abs
## 31                               0.7785983
## 262                              0.5021576
## 267                              0.5024181
## 288                              0.4693971
## 327                              0.4267408
## 360                              0.3560561
##     Party.fctr.RFE.X.zv.pca.rcv.glmnet
## 31                                   D
## 262                                  R
## 267                                  R
## 288                                  R
## 327                                  R
## 360                                  R
##     Party.fctr.RFE.X.zv.pca.rcv.glmnet.prob
## 31                                0.2819092
## 262                               0.5620242
## 267                               0.5336938
## 288                               0.5859141
## 327                               0.6205193
## 360                               0.5782246
##     Party.fctr.RFE.X.zv.pca.rcv.glmnet.is.acc
## 31                                      FALSE
## 262                                      TRUE
## 267                                      TRUE
## 288                                      TRUE
## 327                                      TRUE
## 360                                      TRUE
##     Party.fctr.RFE.X.zv.pca.rcv.glmnet.err
## 31                                    TRUE
## 262                                  FALSE
## 267                                  FALSE
## 288                                  FALSE
## 327                                  FALSE
## 360                                  FALSE
##     Party.fctr.RFE.X.zv.pca.rcv.glmnet.err.abs
## 31                                   0.7180908
## 262                                  0.4379758
## 267                                  0.4663062
## 288                                  0.4140859
## 327                                  0.3794807
## 360                                  0.4217754
##     Party.fctr.All.X.nzv.spatialSign.rcv.glmnet
## 31                                            D
## 262                                           D
## 267                                           D
## 288                                           D
## 327                                           D
## 360                                           R
##     Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## 31                                         0.2327865
## 262                                        0.5347997
## 267                                        0.5570145
## 288                                        0.5505575
## 327                                        0.5369171
## 360                                        0.6280990
##     Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.is.acc
## 31                                               FALSE
## 262                                              FALSE
## 267                                              FALSE
## 288                                              FALSE
## 327                                              FALSE
## 360                                               TRUE
##     Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.err
## 31                                             TRUE
## 262                                            TRUE
## 267                                            TRUE
## 288                                            TRUE
## 327                                            TRUE
## 360                                           FALSE
##     Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.err.abs
## 31                                            0.7672135
## 262                                           0.4652003
## 267                                           0.4429855
## 288                                           0.4494425
## 327                                           0.4630829
## 360                                           0.3719010
##     Party.fctr.All.X.spatialSign.rcv.glmnet
## 31                                        D
## 262                                       D
## 267                                       D
## 288                                       D
## 327                                       D
## 360                                       R
##     Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## 31                                     0.1729998
## 262                                    0.5448110
## 267                                    0.5605040
## 288                                    0.5149217
## 327                                    0.5423338
## 360                                    0.6195644
##     Party.fctr.All.X.spatialSign.rcv.glmnet.is.acc
## 31                                           FALSE
## 262                                          FALSE
## 267                                          FALSE
## 288                                          FALSE
## 327                                          FALSE
## 360                                           TRUE
##     Party.fctr.All.X.spatialSign.rcv.glmnet.err
## 31                                         TRUE
## 262                                        TRUE
## 267                                        TRUE
## 288                                        TRUE
## 327                                        TRUE
## 360                                       FALSE
##     Party.fctr.All.X.spatialSign.rcv.glmnet.err.abs
## 31                                        0.8270002
## 262                                       0.4551890
## 267                                       0.4394960
## 288                                       0.4850783
## 327                                       0.4576662
## 360                                       0.3804356
##     Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet
## 31                                            D
## 262                                           D
## 267                                           D
## 288                                           D
## 327                                           D
## 360                                           R
##     Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.prob
## 31                                         0.2330820
## 262                                        0.5379153
## 267                                        0.5592038
## 288                                        0.5498453
## 327                                        0.5378675
## 360                                        0.6278765
##     Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.is.acc
## 31                                               FALSE
## 262                                              FALSE
## 267                                              FALSE
## 288                                              FALSE
## 327                                              FALSE
## 360                                               TRUE
##     Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.err
## 31                                             TRUE
## 262                                            TRUE
## 267                                            TRUE
## 288                                            TRUE
## 327                                            TRUE
## 360                                           FALSE
##     Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.err.abs
## 31                                            0.7669180
## 262                                           0.4620847
## 267                                           0.4407962
## 288                                           0.4501547
## 327                                           0.4621325
## 360                                           0.3721235
##     Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet
## 31                                                D
## 262                                               D
## 267                                               D
## 288                                               D
## 327                                               D
## 360                                               R
##     Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.prob
## 31                                             0.2121948
## 262                                            0.5343603
## 267                                            0.5593713
## 288                                            0.5493420
## 327                                            0.5508719
## 360                                            0.6233790
##     Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.is.acc
## 31                                                   FALSE
## 262                                                  FALSE
## 267                                                  FALSE
## 288                                                  FALSE
## 327                                                  FALSE
## 360                                                   TRUE
##     Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.err
## 31                                                 TRUE
## 262                                                TRUE
## 267                                                TRUE
## 288                                                TRUE
## 327                                                TRUE
## 360                                               FALSE
##     Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.err.abs
## 31                                                0.7878052
## 262                                               0.4656397
## 267                                               0.4406287
## 288                                               0.4506580
## 327                                               0.4491281
## 360                                               0.3766210
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet
## 31                                        D
## 262                                       D
## 267                                       D
## 288                                       D
## 327                                       D
## 360                                       R
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## 31                                     0.1734391
## 262                                    0.5452467
## 267                                    0.5601738
## 288                                    0.5152925
## 327                                    0.5418288
## 360                                    0.6187148
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.is.acc
## 31                                           FALSE
## 262                                          FALSE
## 267                                          FALSE
## 288                                          FALSE
## 327                                          FALSE
## 360                                           TRUE
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.err
## 31                                         TRUE
## 262                                        TRUE
## 267                                        TRUE
## 288                                        TRUE
## 327                                        TRUE
## 360                                       FALSE
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.err.abs
## 31                                        0.8265609
## 262                                       0.4547533
## 267                                       0.4398262
## 288                                       0.4847075
## 327                                       0.4581712
## 360                                       0.3812852
##     Party.fctr.All.X.nzv.rcv.glmnet Party.fctr.All.X.nzv.rcv.glmnet.prob
## 31                                D                            0.2738594
## 262                               D                            0.5097906
## 267                               D                            0.5501511
## 288                               D                            0.5242825
## 327                               D                            0.5532106
## 360                               R                            0.6333499
##     Party.fctr.All.X.nzv.rcv.glmnet.is.acc
## 31                                   FALSE
## 262                                  FALSE
## 267                                  FALSE
## 288                                  FALSE
## 327                                  FALSE
## 360                                   TRUE
##     Party.fctr.All.X.nzv.rcv.glmnet.err
## 31                                 TRUE
## 262                                TRUE
## 267                                TRUE
## 288                                TRUE
## 327                                TRUE
## 360                               FALSE
##     Party.fctr.All.X.nzv.rcv.glmnet.err.abs
## 31                                0.7261406
## 262                               0.4902094
## 267                               0.4498489
## 288                               0.4757175
## 327                               0.4467894
## 360                               0.3666501
##     Party.fctr.RFE.X.nzv.rcv.glmnet Party.fctr.RFE.X.nzv.rcv.glmnet.prob
## 31                                D                            0.2734827
## 262                               D                            0.5135520
## 267                               R                            0.5534085
## 288                               D                            0.5228244
## 327                               R                            0.5545500
## 360                               R                            0.6335491
##     Party.fctr.RFE.X.nzv.rcv.glmnet.is.acc
## 31                                   FALSE
## 262                                  FALSE
## 267                                   TRUE
## 288                                  FALSE
## 327                                   TRUE
## 360                                   TRUE
##     Party.fctr.RFE.X.nzv.rcv.glmnet.err
## 31                                 TRUE
## 262                                TRUE
## 267                               FALSE
## 288                                TRUE
## 327                               FALSE
## 360                               FALSE
##     Party.fctr.RFE.X.nzv.rcv.glmnet.err.abs
## 31                                0.7265173
## 262                               0.4864480
## 267                               0.4465915
## 288                               0.4771756
## 327                               0.4454500
## 360                               0.3664509
##     Party.fctr.All.X.expoTrans.rcv.glmnet
## 31                                      D
## 262                                     D
## 267                                     R
## 288                                     D
## 327                                     R
## 360                                     R
##     Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## 31                                   0.2109563
## 262                                  0.3355963
## 267                                  0.5505559
## 288                                  0.4980658
## 327                                  0.5504247
## 360                                  0.6212610
##     Party.fctr.All.X.expoTrans.rcv.glmnet.is.acc
## 31                                         FALSE
## 262                                        FALSE
## 267                                         TRUE
## 288                                        FALSE
## 327                                         TRUE
## 360                                         TRUE
##     Party.fctr.All.X.expoTrans.rcv.glmnet.err
## 31                                       TRUE
## 262                                      TRUE
## 267                                     FALSE
## 288                                      TRUE
## 327                                     FALSE
## 360                                     FALSE
##     Party.fctr.All.X.expoTrans.rcv.glmnet.err.abs
## 31                                      0.7890437
## 262                                     0.6644037
## 267                                     0.4494441
## 288                                     0.5019342
## 327                                     0.4495753
## 360                                     0.3787390
##     Party.fctr.RFE.X.expoTrans.rcv.glmnet
## 31                                      D
## 262                                     D
## 267                                     R
## 288                                     D
## 327                                     R
## 360                                     R
##     Party.fctr.RFE.X.expoTrans.rcv.glmnet.prob
## 31                                   0.2109563
## 262                                  0.3355963
## 267                                  0.5505559
## 288                                  0.4980658
## 327                                  0.5504247
## 360                                  0.6212610
##     Party.fctr.RFE.X.expoTrans.rcv.glmnet.is.acc
## 31                                         FALSE
## 262                                        FALSE
## 267                                         TRUE
## 288                                        FALSE
## 327                                         TRUE
## 360                                         TRUE
##     Party.fctr.RFE.X.expoTrans.rcv.glmnet.err
## 31                                       TRUE
## 262                                      TRUE
## 267                                     FALSE
## 288                                      TRUE
## 327                                     FALSE
## 360                                     FALSE
##     Party.fctr.RFE.X.expoTrans.rcv.glmnet.err.abs
## 31                                      0.7890437
## 262                                     0.6644037
## 267                                     0.4494441
## 288                                     0.5019342
## 327                                     0.4495753
## 360                                     0.3787390
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet
## 31                                       D
## 262                                      D
## 267                                      R
## 288                                      D
## 327                                      R
## 360                                      R
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## 31                                   0.21111166
## 262                                  0.06306437
## 267                                  0.55066566
## 288                                  0.49821141
## 327                                  0.55050386
## 360                                  0.62134209
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.is.acc
## 31                                          FALSE
## 262                                         FALSE
## 267                                          TRUE
## 288                                         FALSE
## 327                                          TRUE
## 360                                          TRUE
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.err
## 31                                        TRUE
## 262                                       TRUE
## 267                                      FALSE
## 288                                       TRUE
## 327                                      FALSE
## 360                                      FALSE
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.err.abs
## 31                                       0.7888883
## 262                                      0.9369356
## 267                                      0.4493343
## 288                                      0.5017886
## 327                                      0.4494961
## 360                                      0.3786579
##     Party.fctr.RFE.X.YeoJohnson.rcv.glmnet
## 31                                       D
## 262                                      D
## 267                                      R
## 288                                      D
## 327                                      R
## 360                                      R
##     Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## 31                                   0.21111166
## 262                                  0.06306437
## 267                                  0.55066566
## 288                                  0.49821141
## 327                                  0.55050386
## 360                                  0.62134209
##     Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.is.acc
## 31                                          FALSE
## 262                                         FALSE
## 267                                          TRUE
## 288                                         FALSE
## 327                                          TRUE
## 360                                          TRUE
##     Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.err
## 31                                        TRUE
## 262                                       TRUE
## 267                                      FALSE
## 288                                       TRUE
## 327                                      FALSE
## 360                                      FALSE
##     Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.err.abs
## 31                                       0.7888883
## 262                                      0.9369356
## 267                                      0.4493343
## 288                                      0.5017886
## 327                                      0.4494961
## 360                                      0.3786579
##     Party.fctr.RFE.X..rcv.rpart Party.fctr.RFE.X..rcv.rpart.prob
## 31                            D                        0.1327078
## 262                           R                        0.6666667
## 267                           D                        0.4638143
## 288                           D                        0.4638143
## 327                           D                        0.4638143
## 360                           R                        0.6035857
##     Party.fctr.RFE.X..rcv.rpart.is.acc Party.fctr.RFE.X..rcv.rpart.err
## 31                               FALSE                            TRUE
## 262                               TRUE                           FALSE
## 267                              FALSE                            TRUE
## 288                              FALSE                            TRUE
## 327                              FALSE                            TRUE
## 360                               TRUE                           FALSE
##     Party.fctr.RFE.X..rcv.rpart.err.abs Party.fctr.RFE.X..rcv.glmnet
## 31                            0.8672922                            D
## 262                           0.3333333                            D
## 267                           0.5361857                            R
## 288                           0.5361857                            D
## 327                           0.5361857                            R
## 360                           0.3964143                            R
##     Party.fctr.RFE.X..rcv.glmnet.prob Party.fctr.RFE.X..rcv.glmnet.is.acc
## 31                          0.2102179                               FALSE
## 262                         0.5255076                               FALSE
## 267                         0.5504214                                TRUE
## 288                         0.4976244                               FALSE
## 327                         0.5513170                                TRUE
## 360                         0.6224110                                TRUE
##     Party.fctr.RFE.X..rcv.glmnet.err Party.fctr.RFE.X..rcv.glmnet.err.abs
## 31                              TRUE                            0.7897821
## 262                             TRUE                            0.4744924
## 267                            FALSE                            0.4495786
## 288                             TRUE                            0.5023756
## 327                            FALSE                            0.4486830
## 360                            FALSE                            0.3775890
##     Party.fctr.All.X.conditionalX.rcv.glmnet
## 31                                         D
## 262                                        D
## 267                                        R
## 288                                        D
## 327                                        R
## 360                                        R
##     Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## 31                                      0.2102179
## 262                                     0.5255076
## 267                                     0.5504214
## 288                                     0.4976244
## 327                                     0.5513170
## 360                                     0.6224110
##     Party.fctr.All.X.conditionalX.rcv.glmnet.is.acc
## 31                                            FALSE
## 262                                           FALSE
## 267                                            TRUE
## 288                                           FALSE
## 327                                            TRUE
## 360                                            TRUE
##     Party.fctr.All.X.conditionalX.rcv.glmnet.err
## 31                                          TRUE
## 262                                         TRUE
## 267                                        FALSE
## 288                                         TRUE
## 327                                        FALSE
## 360                                        FALSE
##     Party.fctr.All.X.conditionalX.rcv.glmnet.err.abs
## 31                                         0.7897821
## 262                                        0.4744924
## 267                                        0.4495786
## 288                                        0.5023756
## 327                                        0.4486830
## 360                                        0.3775890
##     Party.fctr.All.X..rcv.glmnet Party.fctr.All.X..rcv.glmnet.prob
## 31                             D                         0.2102179
## 262                            D                         0.5255076
## 267                            R                         0.5504214
## 288                            D                         0.4976244
## 327                            R                         0.5513170
## 360                            R                         0.6224110
##     Party.fctr.All.X..rcv.glmnet.is.acc Party.fctr.All.X..rcv.glmnet.err
## 31                                FALSE                             TRUE
## 262                               FALSE                             TRUE
## 267                                TRUE                            FALSE
## 288                               FALSE                             TRUE
## 327                                TRUE                            FALSE
## 360                                TRUE                            FALSE
##     Party.fctr.All.X..rcv.glmnet.err.abs Party.fctr.Low.cor.X..rcv.glmnet
## 31                             0.7897821                                D
## 262                            0.4744924                                D
## 267                            0.4495786                                R
## 288                            0.5023756                                D
## 327                            0.4486830                                R
## 360                            0.3775890                                R
##     Party.fctr.Low.cor.X..rcv.glmnet.prob
## 31                              0.2102179
## 262                             0.5255076
## 267                             0.5504214
## 288                             0.4976244
## 327                             0.5513170
## 360                             0.6224110
##     Party.fctr.Low.cor.X..rcv.glmnet.is.acc
## 31                                    FALSE
## 262                                   FALSE
## 267                                    TRUE
## 288                                   FALSE
## 327                                    TRUE
## 360                                    TRUE
##     Party.fctr.Low.cor.X..rcv.glmnet.err
## 31                                  TRUE
## 262                                 TRUE
## 267                                FALSE
## 288                                 TRUE
## 327                                FALSE
## 360                                FALSE
##     Party.fctr.Low.cor.X..rcv.glmnet.err.abs
## 31                                 0.7897821
## 262                                0.4744924
## 267                                0.4495786
## 288                                0.5023756
## 327                                0.4486830
## 360                                0.3775890
##     Party.fctr.RFE.X.conditionalX.rcv.glmnet
## 31                                         D
## 262                                        D
## 267                                        R
## 288                                        D
## 327                                        R
## 360                                        R
##     Party.fctr.RFE.X.conditionalX.rcv.glmnet.prob
## 31                                      0.2102179
## 262                                     0.5255076
## 267                                     0.5504214
## 288                                     0.4976244
## 327                                     0.5513170
## 360                                     0.6224110
##     Party.fctr.RFE.X.conditionalX.rcv.glmnet.is.acc
## 31                                            FALSE
## 262                                           FALSE
## 267                                            TRUE
## 288                                           FALSE
## 327                                            TRUE
## 360                                            TRUE
##     Party.fctr.RFE.X.conditionalX.rcv.glmnet.err
## 31                                          TRUE
## 262                                         TRUE
## 267                                        FALSE
## 288                                         TRUE
## 327                                        FALSE
## 360                                        FALSE
##     Party.fctr.RFE.X.conditionalX.rcv.glmnet.err.abs
## 31                                         0.7897821
## 262                                        0.4744924
## 267                                        0.4495786
## 288                                        0.5023756
## 327                                        0.4486830
## 360                                        0.3775890
##     Party.fctr.All.X.zv.rcv.glmnet Party.fctr.All.X.zv.rcv.glmnet.prob
## 31                               D                           0.2102179
## 262                              D                           0.5255076
## 267                              R                           0.5504214
## 288                              D                           0.4976244
## 327                              R                           0.5513170
## 360                              R                           0.6224110
##     Party.fctr.All.X.zv.rcv.glmnet.is.acc
## 31                                  FALSE
## 262                                 FALSE
## 267                                  TRUE
## 288                                 FALSE
## 327                                  TRUE
## 360                                  TRUE
##     Party.fctr.All.X.zv.rcv.glmnet.err
## 31                                TRUE
## 262                               TRUE
## 267                              FALSE
## 288                               TRUE
## 327                              FALSE
## 360                              FALSE
##     Party.fctr.All.X.zv.rcv.glmnet.err.abs Party.fctr.RFE.X.zv.rcv.glmnet
## 31                               0.7897821                              D
## 262                              0.4744924                              D
## 267                              0.4495786                              R
## 288                              0.5023756                              D
## 327                              0.4486830                              R
## 360                              0.3775890                              R
##     Party.fctr.RFE.X.zv.rcv.glmnet.prob
## 31                            0.2102179
## 262                           0.5255076
## 267                           0.5504214
## 288                           0.4976244
## 327                           0.5513170
## 360                           0.6224110
##     Party.fctr.RFE.X.zv.rcv.glmnet.is.acc
## 31                                  FALSE
## 262                                 FALSE
## 267                                  TRUE
## 288                                 FALSE
## 327                                  TRUE
## 360                                  TRUE
##     Party.fctr.RFE.X.zv.rcv.glmnet.err
## 31                                TRUE
## 262                               TRUE
## 267                              FALSE
## 288                               TRUE
## 327                              FALSE
## 360                              FALSE
##     Party.fctr.RFE.X.zv.rcv.glmnet.err.abs
## 31                               0.7897821
## 262                              0.4744924
## 267                              0.4495786
## 288                              0.5023756
## 327                              0.4486830
## 360                              0.3775890
##     Party.fctr.RFE.X.scale.rcv.glmnet
## 31                                  D
## 262                                 D
## 267                                 R
## 288                                 D
## 327                                 R
## 360                                 R
##     Party.fctr.RFE.X.scale.rcv.glmnet.prob
## 31                               0.2102179
## 262                              0.5255076
## 267                              0.5504214
## 288                              0.4976244
## 327                              0.5513170
## 360                              0.6224110
##     Party.fctr.RFE.X.scale.rcv.glmnet.is.acc
## 31                                     FALSE
## 262                                    FALSE
## 267                                     TRUE
## 288                                    FALSE
## 327                                     TRUE
## 360                                     TRUE
##     Party.fctr.RFE.X.scale.rcv.glmnet.err
## 31                                   TRUE
## 262                                  TRUE
## 267                                 FALSE
## 288                                  TRUE
## 327                                 FALSE
## 360                                 FALSE
##     Party.fctr.RFE.X.scale.rcv.glmnet.err.abs
## 31                                  0.7897821
## 262                                 0.4744924
## 267                                 0.4495786
## 288                                 0.5023756
## 327                                 0.4486830
## 360                                 0.3775890
##     Party.fctr.RFE.X.center.rcv.glmnet
## 31                                   D
## 262                                  D
## 267                                  R
## 288                                  D
## 327                                  R
## 360                                  R
##     Party.fctr.RFE.X.center.rcv.glmnet.prob
## 31                                0.2102179
## 262                               0.5255076
## 267                               0.5504214
## 288                               0.4976244
## 327                               0.5513170
## 360                               0.6224110
##     Party.fctr.RFE.X.center.rcv.glmnet.is.acc
## 31                                      FALSE
## 262                                     FALSE
## 267                                      TRUE
## 288                                     FALSE
## 327                                      TRUE
## 360                                      TRUE
##     Party.fctr.RFE.X.center.rcv.glmnet.err
## 31                                    TRUE
## 262                                   TRUE
## 267                                  FALSE
## 288                                   TRUE
## 327                                  FALSE
## 360                                  FALSE
##     Party.fctr.RFE.X.center.rcv.glmnet.err.abs
## 31                                   0.7897821
## 262                                  0.4744924
## 267                                  0.4495786
## 288                                  0.5023756
## 327                                  0.4486830
## 360                                  0.3775890
##     Party.fctr.All.X.scale.rcv.glmnet
## 31                                  D
## 262                                 D
## 267                                 R
## 288                                 D
## 327                                 R
## 360                                 R
##     Party.fctr.All.X.scale.rcv.glmnet.prob
## 31                               0.2102179
## 262                              0.5255076
## 267                              0.5504214
## 288                              0.4976244
## 327                              0.5513170
## 360                              0.6224110
##     Party.fctr.All.X.scale.rcv.glmnet.is.acc
## 31                                     FALSE
## 262                                    FALSE
## 267                                     TRUE
## 288                                    FALSE
## 327                                     TRUE
## 360                                     TRUE
##     Party.fctr.All.X.scale.rcv.glmnet.err
## 31                                   TRUE
## 262                                  TRUE
## 267                                 FALSE
## 288                                  TRUE
## 327                                 FALSE
## 360                                 FALSE
##     Party.fctr.All.X.scale.rcv.glmnet.err.abs
## 31                                  0.7897821
## 262                                 0.4744924
## 267                                 0.4495786
## 288                                 0.5023756
## 327                                 0.4486830
## 360                                 0.3775890
##     Party.fctr.All.X.center.rcv.glmnet
## 31                                   D
## 262                                  D
## 267                                  R
## 288                                  D
## 327                                  R
## 360                                  R
##     Party.fctr.All.X.center.rcv.glmnet.prob
## 31                                0.2102179
## 262                               0.5255076
## 267                               0.5504214
## 288                               0.4976244
## 327                               0.5513170
## 360                               0.6224110
##     Party.fctr.All.X.center.rcv.glmnet.is.acc
## 31                                      FALSE
## 262                                     FALSE
## 267                                      TRUE
## 288                                     FALSE
## 327                                      TRUE
## 360                                      TRUE
##     Party.fctr.All.X.center.rcv.glmnet.err
## 31                                    TRUE
## 262                                   TRUE
## 267                                  FALSE
## 288                                   TRUE
## 327                                  FALSE
## 360                                  FALSE
##     Party.fctr.All.X.center.rcv.glmnet.err.abs
## 31                                   0.7897821
## 262                                  0.4744924
## 267                                  0.4495786
## 288                                  0.5023756
## 327                                  0.4486830
## 360                                  0.3775890
##     Party.fctr.RFE.X.range.rcv.glmnet
## 31                                  D
## 262                                 D
## 267                                 R
## 288                                 D
## 327                                 R
## 360                                 R
##     Party.fctr.RFE.X.range.rcv.glmnet.prob
## 31                               0.2102179
## 262                              0.5255076
## 267                              0.5504214
## 288                              0.4976244
## 327                              0.5513170
## 360                              0.6224110
##     Party.fctr.RFE.X.range.rcv.glmnet.is.acc
## 31                                     FALSE
## 262                                    FALSE
## 267                                     TRUE
## 288                                    FALSE
## 327                                     TRUE
## 360                                     TRUE
##     Party.fctr.RFE.X.range.rcv.glmnet.err
## 31                                   TRUE
## 262                                  TRUE
## 267                                 FALSE
## 288                                  TRUE
## 327                                 FALSE
## 360                                 FALSE
##     Party.fctr.RFE.X.range.rcv.glmnet.err.abs
## 31                                  0.7897821
## 262                                 0.4744924
## 267                                 0.4495786
## 288                                 0.5023756
## 327                                 0.4486830
## 360                                 0.3775890
##     Party.fctr.RFE.X.BoxCox.rcv.glmnet
## 31                                   D
## 262                                  D
## 267                                  R
## 288                                  D
## 327                                  R
## 360                                  R
##     Party.fctr.RFE.X.BoxCox.rcv.glmnet.prob
## 31                                0.2102179
## 262                               0.5255076
## 267                               0.5504214
## 288                               0.4976244
## 327                               0.5513170
## 360                               0.6224110
##     Party.fctr.RFE.X.BoxCox.rcv.glmnet.is.acc
## 31                                      FALSE
## 262                                     FALSE
## 267                                      TRUE
## 288                                     FALSE
## 327                                      TRUE
## 360                                      TRUE
##     Party.fctr.RFE.X.BoxCox.rcv.glmnet.err
## 31                                    TRUE
## 262                                   TRUE
## 267                                  FALSE
## 288                                   TRUE
## 327                                  FALSE
## 360                                  FALSE
##     Party.fctr.RFE.X.BoxCox.rcv.glmnet.err.abs
## 31                                   0.7897821
## 262                                  0.4744924
## 267                                  0.4495786
## 288                                  0.5023756
## 327                                  0.4486830
## 360                                  0.3775890
##     Party.fctr.All.X.range.rcv.glmnet
## 31                                  D
## 262                                 D
## 267                                 R
## 288                                 D
## 327                                 R
## 360                                 R
##     Party.fctr.All.X.range.rcv.glmnet.prob
## 31                               0.2102179
## 262                              0.5255076
## 267                              0.5504214
## 288                              0.4976244
## 327                              0.5513170
## 360                              0.6224110
##     Party.fctr.All.X.range.rcv.glmnet.is.acc
## 31                                     FALSE
## 262                                    FALSE
## 267                                     TRUE
## 288                                    FALSE
## 327                                     TRUE
## 360                                     TRUE
##     Party.fctr.All.X.range.rcv.glmnet.err
## 31                                   TRUE
## 262                                  TRUE
## 267                                 FALSE
## 288                                  TRUE
## 327                                 FALSE
## 360                                 FALSE
##     Party.fctr.All.X.range.rcv.glmnet.err.abs
## 31                                  0.7897821
## 262                                 0.4744924
## 267                                 0.4495786
## 288                                 0.5023756
## 327                                 0.4486830
## 360                                 0.3775890
##     Party.fctr.All.X.BoxCox.rcv.glmnet
## 31                                   D
## 262                                  D
## 267                                  R
## 288                                  D
## 327                                  R
## 360                                  R
##     Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## 31                                0.2102179
## 262                               0.5255076
## 267                               0.5504214
## 288                               0.4976244
## 327                               0.5513170
## 360                               0.6224110
##     Party.fctr.All.X.BoxCox.rcv.glmnet.is.acc
## 31                                      FALSE
## 262                                     FALSE
## 267                                      TRUE
## 288                                     FALSE
## 327                                      TRUE
## 360                                      TRUE
##     Party.fctr.All.X.BoxCox.rcv.glmnet.err
## 31                                    TRUE
## 262                                   TRUE
## 267                                  FALSE
## 288                                   TRUE
## 327                                  FALSE
## 360                                  FALSE
##     Party.fctr.All.X.BoxCox.rcv.glmnet.err.abs
## 31                                   0.7897821
## 262                                  0.4744924
## 267                                  0.4495786
## 288                                  0.5023756
## 327                                  0.4486830
## 360                                  0.3775890
##     Party.fctr.RFE.X.center.scale.rcv.glmnet
## 31                                         D
## 262                                        D
## 267                                        R
## 288                                        D
## 327                                        R
## 360                                        R
##     Party.fctr.RFE.X.center.scale.rcv.glmnet.prob
## 31                                      0.2102179
## 262                                     0.5255076
## 267                                     0.5504214
## 288                                     0.4976244
## 327                                     0.5513170
## 360                                     0.6224110
##     Party.fctr.RFE.X.center.scale.rcv.glmnet.is.acc
## 31                                            FALSE
## 262                                           FALSE
## 267                                            TRUE
## 288                                           FALSE
## 327                                            TRUE
## 360                                            TRUE
##     Party.fctr.RFE.X.center.scale.rcv.glmnet.err
## 31                                          TRUE
## 262                                         TRUE
## 267                                        FALSE
## 288                                         TRUE
## 327                                        FALSE
## 360                                        FALSE
##     Party.fctr.RFE.X.center.scale.rcv.glmnet.err.abs
## 31                                         0.7897821
## 262                                        0.4744924
## 267                                        0.4495786
## 288                                        0.5023756
## 327                                        0.4486830
## 360                                        0.3775890
##     Party.fctr.All.X.center.scale.rcv.glmnet
## 31                                         D
## 262                                        D
## 267                                        R
## 288                                        D
## 327                                        R
## 360                                        R
##     Party.fctr.All.X.center.scale.rcv.glmnet.prob
## 31                                      0.2102179
## 262                                     0.5255076
## 267                                     0.5504214
## 288                                     0.4976244
## 327                                     0.5513170
## 360                                     0.6224110
##     Party.fctr.All.X.center.scale.rcv.glmnet.is.acc
## 31                                            FALSE
## 262                                           FALSE
## 267                                            TRUE
## 288                                           FALSE
## 327                                            TRUE
## 360                                            TRUE
##     Party.fctr.All.X.center.scale.rcv.glmnet.err
## 31                                          TRUE
## 262                                         TRUE
## 267                                        FALSE
## 288                                         TRUE
## 327                                        FALSE
## 360                                        FALSE
##     Party.fctr.All.X.center.scale.rcv.glmnet.err.abs
## 31                                         0.7897821
## 262                                        0.4744924
## 267                                        0.4495786
## 288                                        0.5023756
## 327                                        0.4486830
## 360                                        0.3775890
##     Party.fctr.All.X.zv.pca.rcv.glmnet
## 31                                   D
## 262                                  R
## 267                                  R
## 288                                  R
## 327                                  R
## 360                                  R
##     Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## 31                                0.2975234
## 262                               0.5163644
## 267                               0.5338421
## 288                               0.5564895
## 327                               0.5545310
## 360                               0.5396139
##     Party.fctr.All.X.zv.pca.rcv.glmnet.is.acc
## 31                                      FALSE
## 262                                      TRUE
## 267                                      TRUE
## 288                                      TRUE
## 327                                      TRUE
## 360                                      TRUE
##     Party.fctr.All.X.zv.pca.rcv.glmnet.err
## 31                                    TRUE
## 262                                  FALSE
## 267                                  FALSE
## 288                                  FALSE
## 327                                  FALSE
## 360                                  FALSE
##     Party.fctr.All.X.zv.pca.rcv.glmnet.err.abs Party.fctr.RFE.X..rcv.gbm
## 31                                   0.7024766                         D
## 262                                  0.4836356                         D
## 267                                  0.4661579                         D
## 288                                  0.4435105                         D
## 327                                  0.4454690                         D
## 360                                  0.4603861                         R
##     Party.fctr.RFE.X..rcv.gbm.prob Party.fctr.RFE.X..rcv.gbm.is.acc
## 31                       0.1850808                            FALSE
## 262                      0.5454766                            FALSE
## 267                      0.5082175                            FALSE
## 288                      0.4847184                            FALSE
## 327                      0.5334739                            FALSE
## 360                      0.6443365                             TRUE
##     Party.fctr.RFE.X..rcv.gbm.err Party.fctr.RFE.X..rcv.gbm.err.abs
## 31                           TRUE                         0.8149192
## 262                          TRUE                         0.4545234
## 267                          TRUE                         0.4917825
## 288                          TRUE                         0.5152816
## 327                          TRUE                         0.4665261
## 360                         FALSE                         0.3556635
##     Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet
## 31                                                D
## 262                                               D
## 267                                               D
## 288                                               D
## 327                                               D
## 360                                               R
##     Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.prob
## 31                                             0.2172038
## 262                                            0.5315002
## 267                                            0.5083768
## 288                                            0.4859203
## 327                                            0.5492738
## 360                                            0.6347761
##     Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.is.acc
## 31                                                   FALSE
## 262                                                  FALSE
## 267                                                  FALSE
## 288                                                  FALSE
## 327                                                  FALSE
## 360                                                   TRUE
##     Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.err
## 31                                                 TRUE
## 262                                                TRUE
## 267                                                TRUE
## 288                                                TRUE
## 327                                                TRUE
## 360                                               FALSE
##     Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.err.abs
## 31                                                0.7827962
## 262                                               0.4684998
## 267                                               0.4916232
## 288                                               0.5140797
## 327                                               0.4507262
## 360                                               0.3652239
##     Party.fctr.RFE.X..rcv.earth Party.fctr.RFE.X..rcv.earth.prob
## 31                            D                        0.1485890
## 262                           D                        0.4947096
## 267                           D                        0.4670798
## 288                           D                        0.5218972
## 327                           D                        0.5844842
## 360                           R                        0.6236118
##     Party.fctr.RFE.X..rcv.earth.is.acc Party.fctr.RFE.X..rcv.earth.err
## 31                               FALSE                            TRUE
## 262                              FALSE                            TRUE
## 267                              FALSE                            TRUE
## 288                              FALSE                            TRUE
## 327                              FALSE                            TRUE
## 360                               TRUE                           FALSE
##     Party.fctr.RFE.X..rcv.earth.err.abs Party.fctr.RFE.X..rcv.glm
## 31                            0.8514110                         D
## 262                           0.5052904                         D
## 267                           0.5329202                         D
## 288                           0.4781028                         D
## 327                           0.4155158                         D
## 360                           0.3763882                         D
##     Party.fctr.RFE.X..rcv.glm.prob Party.fctr.RFE.X..rcv.glm.is.acc
## 31                       0.2418548                            FALSE
## 262                      0.4571514                            FALSE
## 267                      0.5049953                            FALSE
## 288                      0.6265824                            FALSE
## 327                      0.5618965                            FALSE
## 360                      0.5770678                            FALSE
##     Party.fctr.RFE.X..rcv.glm.err Party.fctr.RFE.X..rcv.glm.err.abs
## 31                           TRUE                         0.7581452
## 262                          TRUE                         0.5428486
## 267                          TRUE                         0.4950047
## 288                          TRUE                         0.3734176
## 327                          TRUE                         0.4381035
## 360                          TRUE                         0.4229322
##     Party.fctr.All.X..rcv.glm Party.fctr.All.X..rcv.glm.prob
## 31                          D                      0.2427448
## 262                         D                      0.4492276
## 267                         D                      0.4993871
## 288                         D                      0.6232237
## 327                         D                      0.5546620
## 360                         D                      0.5754790
##     Party.fctr.All.X..rcv.glm.is.acc Party.fctr.All.X..rcv.glm.err
## 31                             FALSE                          TRUE
## 262                            FALSE                          TRUE
## 267                            FALSE                          TRUE
## 288                            FALSE                          TRUE
## 327                            FALSE                          TRUE
## 360                            FALSE                          TRUE
##     Party.fctr.All.X..rcv.glm.err.abs Party.fctr.RFE.X..rcv.rf
## 31                          0.7572552                        D
## 262                         0.5507724                        D
## 267                         0.5006129                        D
## 288                         0.3767763                        D
## 327                         0.4453380                        D
## 360                         0.4245210                        R
##     Party.fctr.RFE.X..rcv.rf.prob Party.fctr.RFE.X..rcv.rf.is.acc
## 31                          0.086                           FALSE
## 262                         0.476                           FALSE
## 267                         0.546                           FALSE
## 288                         0.538                           FALSE
## 327                         0.532                           FALSE
## 360                         0.672                            TRUE
##     Party.fctr.RFE.X..rcv.rf.err Party.fctr.RFE.X..rcv.rf.err.abs
## 31                          TRUE                            0.914
## 262                         TRUE                            0.524
## 267                         TRUE                            0.454
## 288                         TRUE                            0.462
## 327                         TRUE                            0.468
## 360                        FALSE                            0.328
##     Party.fctr.RFE.X..rcv.avNNet Party.fctr.RFE.X..rcv.avNNet.prob
## 31                             D                         0.2090296
## 262                            D                         0.4958937
## 267                            D                         0.4612318
## 288                            R                         0.8062891
## 327                            D                         0.3690896
## 360                            D                         0.5837909
##     Party.fctr.RFE.X..rcv.avNNet.is.acc Party.fctr.RFE.X..rcv.avNNet.err
## 31                                FALSE                             TRUE
## 262                               FALSE                             TRUE
## 267                               FALSE                             TRUE
## 288                                TRUE                            FALSE
## 327                               FALSE                             TRUE
## 360                               FALSE                             TRUE
##     Party.fctr.RFE.X..rcv.avNNet.err.abs Party.fctr.RFE.X..rcv.nnet
## 31                             0.7909704                          D
## 262                            0.5041063                          R
## 267                            0.5387682                          R
## 288                            0.1937109                          R
## 327                            0.6309104                          R
## 360                            0.4162091                          R
##     Party.fctr.RFE.X..rcv.nnet.prob Party.fctr.RFE.X..rcv.nnet.is.acc
## 31                        0.1875778                             FALSE
## 262                       0.7074616                              TRUE
## 267                       0.7210541                              TRUE
## 288                       0.7347615                              TRUE
## 327                       0.7181540                              TRUE
## 360                       0.7341737                              TRUE
##     Party.fctr.RFE.X..rcv.nnet.err Party.fctr.RFE.X..rcv.nnet.err.abs
## 31                            TRUE                          0.8124222
## 262                          FALSE                          0.2925384
## 267                          FALSE                          0.2789459
## 288                          FALSE                          0.2652385
## 327                          FALSE                          0.2818460
## 360                          FALSE                          0.2658263
##     Party.fctr.RFE.X.ica.rcv.glmnet Party.fctr.RFE.X.ica.rcv.glmnet.prob
## 31                                D                            0.4783853
## 262                               D                            0.5158458
## 267                               R                            0.5582405
## 288                               D                            0.4676562
## 327                               D                            0.4136594
## 360                               D                            0.3902197
##     Party.fctr.RFE.X.ica.rcv.glmnet.is.acc
## 31                                   FALSE
## 262                                  FALSE
## 267                                   TRUE
## 288                                  FALSE
## 327                                  FALSE
## 360                                  FALSE
##     Party.fctr.RFE.X.ica.rcv.glmnet.err
## 31                                 TRUE
## 262                                TRUE
## 267                               FALSE
## 288                                TRUE
## 327                                TRUE
## 360                                TRUE
##     Party.fctr.RFE.X.ica.rcv.glmnet.err.abs
## 31                                0.5216147
## 262                               0.4841542
## 267                               0.4417595
## 288                               0.5323438
## 327                               0.5863406
## 360                               0.6097803
##     Party.fctr.All.X.ica.rcv.glmnet Party.fctr.All.X.ica.rcv.glmnet.prob
## 31                                D                            0.4750176
## 262                               D                            0.5154738
## 267                               R                            0.5615687
## 288                               D                            0.4651216
## 327                               D                            0.4164560
## 360                               D                            0.3918949
##     Party.fctr.All.X.ica.rcv.glmnet.is.acc
## 31                                   FALSE
## 262                                  FALSE
## 267                                   TRUE
## 288                                  FALSE
## 327                                  FALSE
## 360                                  FALSE
##     Party.fctr.All.X.ica.rcv.glmnet.err
## 31                                 TRUE
## 262                                TRUE
## 267                               FALSE
## 288                                TRUE
## 327                                TRUE
## 360                                TRUE
##     Party.fctr.All.X.ica.rcv.glmnet.err.abs
## 31                                0.5249824
## 262                               0.4845262
## 267                               0.4384313
## 288                               0.5348784
## 327                               0.5835440
## 360                               0.6081051
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet
## 31                                           D
## 262                                          D
## 267                                          D
## 288                                          D
## 327                                          D
## 360                                          D
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## 31                                        0.1473865
## 262                                       0.3429005
## 267                                       0.6081857
## 288                                       0.5115123
## 327                                       0.6275971
## 360                                       0.6923525
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.is.acc
## 31                                              FALSE
## 262                                             FALSE
## 267                                             FALSE
## 288                                             FALSE
## 327                                             FALSE
## 360                                             FALSE
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.err
## 31                                            TRUE
## 262                                           TRUE
## 267                                           TRUE
## 288                                           TRUE
## 327                                           TRUE
## 360                                           TRUE
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.err.abs
## 31                                           0.8526135
## 262                                          0.6570995
## 267                                          0.3918143
## 288                                          0.4884877
## 327                                          0.3724029
## 360                                          0.3076475
##     Party.fctr.Ensemble.auto.2..rcv.glmnet.prob
## 31                                    0.1085012
## 262                                   0.5211783
## 267                                   0.5250261
## 288                                   0.5487392
## 327                                   0.5960210
## 360                                   0.6348478
##     Party.fctr.Ensemble.auto.2..rcv.glmnet
## 31                                       D
## 262                                      D
## 267                                      D
## 288                                      D
## 327                                      D
## 360                                      D
##     Party.fctr.Ensemble.auto.2..rcv.glmnet.err
## 31                                        TRUE
## 262                                       TRUE
## 267                                       TRUE
## 288                                       TRUE
## 327                                       TRUE
## 360                                       TRUE
##     Party.fctr.Ensemble.auto.2..rcv.glmnet.err.abs
## 31                                       0.8914988
## 262                                      0.4788217
## 267                                      0.4749739
## 288                                      0.4512608
## 327                                      0.4039790
## 360                                      0.3651522
##     Party.fctr.Ensemble.auto.2..rcv.glmnet.is.acc
## 31                                          FALSE
## 262                                         FALSE
## 267                                         FALSE
## 288                                         FALSE
## 327                                         FALSE
## 360                                         FALSE
##     Party.fctr.Ensemble.auto.2..rcv.glmnet.accurate
## 31                                            FALSE
## 262                                           FALSE
## 267                                           FALSE
## 288                                           FALSE
## 327                                           FALSE
## 360                                           FALSE
##     Party.fctr.Ensemble.auto.2..rcv.glmnet.error
## 31                                   -0.54149880
## 262                                  -0.12882166
## 267                                  -0.12497394
## 288                                  -0.10126077
## 327                                  -0.05397903
## 360                                  -0.01515216
##     USER_ID Party.fctr Party.fctr.RFE.X.Inc..rcv.bagEarth
## 454     853          D                                  R
## 455    1309          D                                  R
## 456    3978          D                                  R
## 457     892          D                                  R
## 458     217          D                                  R
## 459    3006          D                                  R
##     Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## 454                               0.8060030
## 455                               0.8208309
## 456                               0.8390278
## 457                               0.8542985
## 458                               0.8765461
## 459                               0.8977183
##     Party.fctr.RFE.X.Inc..rcv.bagEarth.is.acc
## 454                                     FALSE
## 455                                     FALSE
## 456                                     FALSE
## 457                                     FALSE
## 458                                     FALSE
## 459                                     FALSE
##     Party.fctr.RFE.X.Inc..rcv.bagEarth.err
## 454                                   TRUE
## 455                                   TRUE
## 456                                   TRUE
## 457                                   TRUE
## 458                                   TRUE
## 459                                   TRUE
##     Party.fctr.RFE.X.Inc..rcv.bagEarth.err.abs
## 454                                  0.8060030
## 455                                  0.8208309
## 456                                  0.8390278
## 457                                  0.8542985
## 458                                  0.8765461
## 459                                  0.8977183
##     Party.fctr.RFE.X..rcv.bagEarth Party.fctr.RFE.X..rcv.bagEarth.prob
## 454                              R                           0.8353514
## 455                              R                           0.8456653
## 456                              R                           0.8329285
## 457                              R                           0.8419323
## 458                              R                           0.8886195
## 459                              R                           0.8955813
##     Party.fctr.RFE.X..rcv.bagEarth.is.acc
## 454                                 FALSE
## 455                                 FALSE
## 456                                 FALSE
## 457                                 FALSE
## 458                                 FALSE
## 459                                 FALSE
##     Party.fctr.RFE.X..rcv.bagEarth.err
## 454                               TRUE
## 455                               TRUE
## 456                               TRUE
## 457                               TRUE
## 458                               TRUE
## 459                               TRUE
##     Party.fctr.RFE.X..rcv.bagEarth.err.abs
## 454                              0.8353514
## 455                              0.8456653
## 456                              0.8329285
## 457                              0.8419323
## 458                              0.8886195
## 459                              0.8955813
##     Party.fctr.RFE.X.zv.pca.rcv.glmnet
## 454                                  R
## 455                                  R
## 456                                  R
## 457                                  R
## 458                                  R
## 459                                  R
##     Party.fctr.RFE.X.zv.pca.rcv.glmnet.prob
## 454                               0.7902520
## 455                               0.8106673
## 456                               0.8089729
## 457                               0.8034368
## 458                               0.8319108
## 459                               0.7871980
##     Party.fctr.RFE.X.zv.pca.rcv.glmnet.is.acc
## 454                                     FALSE
## 455                                     FALSE
## 456                                     FALSE
## 457                                     FALSE
## 458                                     FALSE
## 459                                     FALSE
##     Party.fctr.RFE.X.zv.pca.rcv.glmnet.err
## 454                                   TRUE
## 455                                   TRUE
## 456                                   TRUE
## 457                                   TRUE
## 458                                   TRUE
## 459                                   TRUE
##     Party.fctr.RFE.X.zv.pca.rcv.glmnet.err.abs
## 454                                  0.7902520
## 455                                  0.8106673
## 456                                  0.8089729
## 457                                  0.8034368
## 458                                  0.8319108
## 459                                  0.7871980
##     Party.fctr.All.X.nzv.spatialSign.rcv.glmnet
## 454                                           R
## 455                                           R
## 456                                           R
## 457                                           R
## 458                                           R
## 459                                           R
##     Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## 454                                        0.7199864
## 455                                        0.7881526
## 456                                        0.7312636
## 457                                        0.7444508
## 458                                        0.7997592
## 459                                        0.7762167
##     Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.is.acc
## 454                                              FALSE
## 455                                              FALSE
## 456                                              FALSE
## 457                                              FALSE
## 458                                              FALSE
## 459                                              FALSE
##     Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.err
## 454                                            TRUE
## 455                                            TRUE
## 456                                            TRUE
## 457                                            TRUE
## 458                                            TRUE
## 459                                            TRUE
##     Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.err.abs
## 454                                           0.7199864
## 455                                           0.7881526
## 456                                           0.7312636
## 457                                           0.7444508
## 458                                           0.7997592
## 459                                           0.7762167
##     Party.fctr.All.X.spatialSign.rcv.glmnet
## 454                                       R
## 455                                       R
## 456                                       R
## 457                                       R
## 458                                       R
## 459                                       R
##     Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## 454                                    0.7266322
## 455                                    0.7877210
## 456                                    0.7528879
## 457                                    0.7547337
## 458                                    0.8085836
## 459                                    0.7661737
##     Party.fctr.All.X.spatialSign.rcv.glmnet.is.acc
## 454                                          FALSE
## 455                                          FALSE
## 456                                          FALSE
## 457                                          FALSE
## 458                                          FALSE
## 459                                          FALSE
##     Party.fctr.All.X.spatialSign.rcv.glmnet.err
## 454                                        TRUE
## 455                                        TRUE
## 456                                        TRUE
## 457                                        TRUE
## 458                                        TRUE
## 459                                        TRUE
##     Party.fctr.All.X.spatialSign.rcv.glmnet.err.abs
## 454                                       0.7266322
## 455                                       0.7877210
## 456                                       0.7528879
## 457                                       0.7547337
## 458                                       0.8085836
## 459                                       0.7661737
##     Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet
## 454                                           R
## 455                                           R
## 456                                           R
## 457                                           R
## 458                                           R
## 459                                           R
##     Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.prob
## 454                                        0.7197814
## 455                                        0.7876670
## 456                                        0.7323013
## 457                                        0.7445485
## 458                                        0.8003782
## 459                                        0.7761224
##     Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.is.acc
## 454                                              FALSE
## 455                                              FALSE
## 456                                              FALSE
## 457                                              FALSE
## 458                                              FALSE
## 459                                              FALSE
##     Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.err
## 454                                            TRUE
## 455                                            TRUE
## 456                                            TRUE
## 457                                            TRUE
## 458                                            TRUE
## 459                                            TRUE
##     Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.err.abs
## 454                                           0.7197814
## 455                                           0.7876670
## 456                                           0.7323013
## 457                                           0.7445485
## 458                                           0.8003782
## 459                                           0.7761224
##     Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet
## 454                                               R
## 455                                               R
## 456                                               R
## 457                                               R
## 458                                               R
## 459                                               R
##     Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.prob
## 454                                            0.7600849
## 455                                            0.8168050
## 456                                            0.7765364
## 457                                            0.7604862
## 458                                            0.8244984
## 459                                            0.7897290
##     Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.is.acc
## 454                                                  FALSE
## 455                                                  FALSE
## 456                                                  FALSE
## 457                                                  FALSE
## 458                                                  FALSE
## 459                                                  FALSE
##     Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.err
## 454                                                TRUE
## 455                                                TRUE
## 456                                                TRUE
## 457                                                TRUE
## 458                                                TRUE
## 459                                                TRUE
##     Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.err.abs
## 454                                               0.7600849
## 455                                               0.8168050
## 456                                               0.7765364
## 457                                               0.7604862
## 458                                               0.8244984
## 459                                               0.7897290
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet
## 454                                       R
## 455                                       R
## 456                                       R
## 457                                       R
## 458                                       R
## 459                                       R
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## 454                                    0.7255455
## 455                                    0.7871647
## 456                                    0.7533857
## 457                                    0.7539711
## 458                                    0.8096699
## 459                                    0.7723208
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.is.acc
## 454                                          FALSE
## 455                                          FALSE
## 456                                          FALSE
## 457                                          FALSE
## 458                                          FALSE
## 459                                          FALSE
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.err
## 454                                        TRUE
## 455                                        TRUE
## 456                                        TRUE
## 457                                        TRUE
## 458                                        TRUE
## 459                                        TRUE
##     Party.fctr.RFE.X.spatialSign.rcv.glmnet.err.abs
## 454                                       0.7255455
## 455                                       0.7871647
## 456                                       0.7533857
## 457                                       0.7539711
## 458                                       0.8096699
## 459                                       0.7723208
##     Party.fctr.All.X.nzv.rcv.glmnet Party.fctr.All.X.nzv.rcv.glmnet.prob
## 454                               R                            0.7385176
## 455                               R                            0.8003803
## 456                               R                            0.7383352
## 457                               R                            0.7582014
## 458                               R                            0.8090116
## 459                               R                            0.7959818
##     Party.fctr.All.X.nzv.rcv.glmnet.is.acc
## 454                                  FALSE
## 455                                  FALSE
## 456                                  FALSE
## 457                                  FALSE
## 458                                  FALSE
## 459                                  FALSE
##     Party.fctr.All.X.nzv.rcv.glmnet.err
## 454                                TRUE
## 455                                TRUE
## 456                                TRUE
## 457                                TRUE
## 458                                TRUE
## 459                                TRUE
##     Party.fctr.All.X.nzv.rcv.glmnet.err.abs
## 454                               0.7385176
## 455                               0.8003803
## 456                               0.7383352
## 457                               0.7582014
## 458                               0.8090116
## 459                               0.7959818
##     Party.fctr.RFE.X.nzv.rcv.glmnet Party.fctr.RFE.X.nzv.rcv.glmnet.prob
## 454                               R                            0.7382392
## 455                               R                            0.8006129
## 456                               R                            0.7393051
## 457                               R                            0.7597933
## 458                               R                            0.8087334
## 459                               R                            0.7918549
##     Party.fctr.RFE.X.nzv.rcv.glmnet.is.acc
## 454                                  FALSE
## 455                                  FALSE
## 456                                  FALSE
## 457                                  FALSE
## 458                                  FALSE
## 459                                  FALSE
##     Party.fctr.RFE.X.nzv.rcv.glmnet.err
## 454                                TRUE
## 455                                TRUE
## 456                                TRUE
## 457                                TRUE
## 458                                TRUE
## 459                                TRUE
##     Party.fctr.RFE.X.nzv.rcv.glmnet.err.abs
## 454                               0.7382392
## 455                               0.8006129
## 456                               0.7393051
## 457                               0.7597933
## 458                               0.8087334
## 459                               0.7918549
##     Party.fctr.All.X.expoTrans.rcv.glmnet
## 454                                     R
## 455                                     R
## 456                                     R
## 457                                     R
## 458                                     R
## 459                                     R
##     Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## 454                                  0.7425161
## 455                                  0.7921285
## 456                                  0.7621913
## 457                                  0.7645389
## 458                                  0.8058837
## 459                                  0.7827551
##     Party.fctr.All.X.expoTrans.rcv.glmnet.is.acc
## 454                                        FALSE
## 455                                        FALSE
## 456                                        FALSE
## 457                                        FALSE
## 458                                        FALSE
## 459                                        FALSE
##     Party.fctr.All.X.expoTrans.rcv.glmnet.err
## 454                                      TRUE
## 455                                      TRUE
## 456                                      TRUE
## 457                                      TRUE
## 458                                      TRUE
## 459                                      TRUE
##     Party.fctr.All.X.expoTrans.rcv.glmnet.err.abs
## 454                                     0.7425161
## 455                                     0.7921285
## 456                                     0.7621913
## 457                                     0.7645389
## 458                                     0.8058837
## 459                                     0.7827551
##     Party.fctr.RFE.X.expoTrans.rcv.glmnet
## 454                                     R
## 455                                     R
## 456                                     R
## 457                                     R
## 458                                     R
## 459                                     R
##     Party.fctr.RFE.X.expoTrans.rcv.glmnet.prob
## 454                                  0.7425161
## 455                                  0.7921285
## 456                                  0.7621913
## 457                                  0.7645389
## 458                                  0.8058837
## 459                                  0.7827551
##     Party.fctr.RFE.X.expoTrans.rcv.glmnet.is.acc
## 454                                        FALSE
## 455                                        FALSE
## 456                                        FALSE
## 457                                        FALSE
## 458                                        FALSE
## 459                                        FALSE
##     Party.fctr.RFE.X.expoTrans.rcv.glmnet.err
## 454                                      TRUE
## 455                                      TRUE
## 456                                      TRUE
## 457                                      TRUE
## 458                                      TRUE
## 459                                      TRUE
##     Party.fctr.RFE.X.expoTrans.rcv.glmnet.err.abs
## 454                                     0.7425161
## 455                                     0.7921285
## 456                                     0.7621913
## 457                                     0.7645389
## 458                                     0.8058837
## 459                                     0.7827551
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet
## 454                                      R
## 455                                      R
## 456                                      R
## 457                                      R
## 458                                      R
## 459                                      R
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## 454                                   0.7426255
## 455                                   0.7921805
## 456                                   0.7623069
## 457                                   0.7646698
## 458                                   0.8060017
## 459                                   0.7827597
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.is.acc
## 454                                         FALSE
## 455                                         FALSE
## 456                                         FALSE
## 457                                         FALSE
## 458                                         FALSE
## 459                                         FALSE
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.err
## 454                                       TRUE
## 455                                       TRUE
## 456                                       TRUE
## 457                                       TRUE
## 458                                       TRUE
## 459                                       TRUE
##     Party.fctr.All.X.YeoJohnson.rcv.glmnet.err.abs
## 454                                      0.7426255
## 455                                      0.7921805
## 456                                      0.7623069
## 457                                      0.7646698
## 458                                      0.8060017
## 459                                      0.7827597
##     Party.fctr.RFE.X.YeoJohnson.rcv.glmnet
## 454                                      R
## 455                                      R
## 456                                      R
## 457                                      R
## 458                                      R
## 459                                      R
##     Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## 454                                   0.7426255
## 455                                   0.7921805
## 456                                   0.7623069
## 457                                   0.7646698
## 458                                   0.8060017
## 459                                   0.7827597
##     Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.is.acc
## 454                                         FALSE
## 455                                         FALSE
## 456                                         FALSE
## 457                                         FALSE
## 458                                         FALSE
## 459                                         FALSE
##     Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.err
## 454                                       TRUE
## 455                                       TRUE
## 456                                       TRUE
## 457                                       TRUE
## 458                                       TRUE
## 459                                       TRUE
##     Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.err.abs
## 454                                      0.7426255
## 455                                      0.7921805
## 456                                      0.7623069
## 457                                      0.7646698
## 458                                      0.8060017
## 459                                      0.7827597
##     Party.fctr.RFE.X..rcv.rpart Party.fctr.RFE.X..rcv.rpart.prob
## 454                           R                        0.6666667
## 455                           R                        0.6666667
## 456                           R                        0.6666667
## 457                           R                        0.6666667
## 458                           R                        0.6666667
## 459                           R                        0.6666667
##     Party.fctr.RFE.X..rcv.rpart.is.acc Party.fctr.RFE.X..rcv.rpart.err
## 454                              FALSE                            TRUE
## 455                              FALSE                            TRUE
## 456                              FALSE                            TRUE
## 457                              FALSE                            TRUE
## 458                              FALSE                            TRUE
## 459                              FALSE                            TRUE
##     Party.fctr.RFE.X..rcv.rpart.err.abs Party.fctr.RFE.X..rcv.glmnet
## 454                           0.6666667                            R
## 455                           0.6666667                            R
## 456                           0.6666667                            R
## 457                           0.6666667                            R
## 458                           0.6666667                            R
## 459                           0.6666667                            R
##     Party.fctr.RFE.X..rcv.glmnet.prob Party.fctr.RFE.X..rcv.glmnet.is.acc
## 454                         0.7424880                               FALSE
## 455                         0.7929111                               FALSE
## 456                         0.7632908                               FALSE
## 457                         0.7639110                               FALSE
## 458                         0.8063896                               FALSE
## 459                         0.7821974                               FALSE
##     Party.fctr.RFE.X..rcv.glmnet.err Party.fctr.RFE.X..rcv.glmnet.err.abs
## 454                             TRUE                            0.7424880
## 455                             TRUE                            0.7929111
## 456                             TRUE                            0.7632908
## 457                             TRUE                            0.7639110
## 458                             TRUE                            0.8063896
## 459                             TRUE                            0.7821974
##     Party.fctr.All.X.conditionalX.rcv.glmnet
## 454                                        R
## 455                                        R
## 456                                        R
## 457                                        R
## 458                                        R
## 459                                        R
##     Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## 454                                     0.7424880
## 455                                     0.7929111
## 456                                     0.7632908
## 457                                     0.7639110
## 458                                     0.8063896
## 459                                     0.7821974
##     Party.fctr.All.X.conditionalX.rcv.glmnet.is.acc
## 454                                           FALSE
## 455                                           FALSE
## 456                                           FALSE
## 457                                           FALSE
## 458                                           FALSE
## 459                                           FALSE
##     Party.fctr.All.X.conditionalX.rcv.glmnet.err
## 454                                         TRUE
## 455                                         TRUE
## 456                                         TRUE
## 457                                         TRUE
## 458                                         TRUE
## 459                                         TRUE
##     Party.fctr.All.X.conditionalX.rcv.glmnet.err.abs
## 454                                        0.7424880
## 455                                        0.7929111
## 456                                        0.7632908
## 457                                        0.7639110
## 458                                        0.8063896
## 459                                        0.7821974
##     Party.fctr.All.X..rcv.glmnet Party.fctr.All.X..rcv.glmnet.prob
## 454                            R                         0.7424880
## 455                            R                         0.7929111
## 456                            R                         0.7632908
## 457                            R                         0.7639110
## 458                            R                         0.8063896
## 459                            R                         0.7821974
##     Party.fctr.All.X..rcv.glmnet.is.acc Party.fctr.All.X..rcv.glmnet.err
## 454                               FALSE                             TRUE
## 455                               FALSE                             TRUE
## 456                               FALSE                             TRUE
## 457                               FALSE                             TRUE
## 458                               FALSE                             TRUE
## 459                               FALSE                             TRUE
##     Party.fctr.All.X..rcv.glmnet.err.abs Party.fctr.Low.cor.X..rcv.glmnet
## 454                            0.7424880                                R
## 455                            0.7929111                                R
## 456                            0.7632908                                R
## 457                            0.7639110                                R
## 458                            0.8063896                                R
## 459                            0.7821974                                R
##     Party.fctr.Low.cor.X..rcv.glmnet.prob
## 454                             0.7424880
## 455                             0.7929111
## 456                             0.7632908
## 457                             0.7639110
## 458                             0.8063896
## 459                             0.7821974
##     Party.fctr.Low.cor.X..rcv.glmnet.is.acc
## 454                                   FALSE
## 455                                   FALSE
## 456                                   FALSE
## 457                                   FALSE
## 458                                   FALSE
## 459                                   FALSE
##     Party.fctr.Low.cor.X..rcv.glmnet.err
## 454                                 TRUE
## 455                                 TRUE
## 456                                 TRUE
## 457                                 TRUE
## 458                                 TRUE
## 459                                 TRUE
##     Party.fctr.Low.cor.X..rcv.glmnet.err.abs
## 454                                0.7424880
## 455                                0.7929111
## 456                                0.7632908
## 457                                0.7639110
## 458                                0.8063896
## 459                                0.7821974
##     Party.fctr.RFE.X.conditionalX.rcv.glmnet
## 454                                        R
## 455                                        R
## 456                                        R
## 457                                        R
## 458                                        R
## 459                                        R
##     Party.fctr.RFE.X.conditionalX.rcv.glmnet.prob
## 454                                     0.7424880
## 455                                     0.7929111
## 456                                     0.7632908
## 457                                     0.7639110
## 458                                     0.8063896
## 459                                     0.7821974
##     Party.fctr.RFE.X.conditionalX.rcv.glmnet.is.acc
## 454                                           FALSE
## 455                                           FALSE
## 456                                           FALSE
## 457                                           FALSE
## 458                                           FALSE
## 459                                           FALSE
##     Party.fctr.RFE.X.conditionalX.rcv.glmnet.err
## 454                                         TRUE
## 455                                         TRUE
## 456                                         TRUE
## 457                                         TRUE
## 458                                         TRUE
## 459                                         TRUE
##     Party.fctr.RFE.X.conditionalX.rcv.glmnet.err.abs
## 454                                        0.7424880
## 455                                        0.7929111
## 456                                        0.7632908
## 457                                        0.7639110
## 458                                        0.8063896
## 459                                        0.7821974
##     Party.fctr.All.X.zv.rcv.glmnet Party.fctr.All.X.zv.rcv.glmnet.prob
## 454                              R                           0.7424880
## 455                              R                           0.7929111
## 456                              R                           0.7632908
## 457                              R                           0.7639110
## 458                              R                           0.8063896
## 459                              R                           0.7821974
##     Party.fctr.All.X.zv.rcv.glmnet.is.acc
## 454                                 FALSE
## 455                                 FALSE
## 456                                 FALSE
## 457                                 FALSE
## 458                                 FALSE
## 459                                 FALSE
##     Party.fctr.All.X.zv.rcv.glmnet.err
## 454                               TRUE
## 455                               TRUE
## 456                               TRUE
## 457                               TRUE
## 458                               TRUE
## 459                               TRUE
##     Party.fctr.All.X.zv.rcv.glmnet.err.abs Party.fctr.RFE.X.zv.rcv.glmnet
## 454                              0.7424880                              R
## 455                              0.7929111                              R
## 456                              0.7632908                              R
## 457                              0.7639110                              R
## 458                              0.8063896                              R
## 459                              0.7821974                              R
##     Party.fctr.RFE.X.zv.rcv.glmnet.prob
## 454                           0.7424880
## 455                           0.7929111
## 456                           0.7632908
## 457                           0.7639110
## 458                           0.8063896
## 459                           0.7821974
##     Party.fctr.RFE.X.zv.rcv.glmnet.is.acc
## 454                                 FALSE
## 455                                 FALSE
## 456                                 FALSE
## 457                                 FALSE
## 458                                 FALSE
## 459                                 FALSE
##     Party.fctr.RFE.X.zv.rcv.glmnet.err
## 454                               TRUE
## 455                               TRUE
## 456                               TRUE
## 457                               TRUE
## 458                               TRUE
## 459                               TRUE
##     Party.fctr.RFE.X.zv.rcv.glmnet.err.abs
## 454                              0.7424880
## 455                              0.7929111
## 456                              0.7632908
## 457                              0.7639110
## 458                              0.8063896
## 459                              0.7821974
##     Party.fctr.RFE.X.scale.rcv.glmnet
## 454                                 R
## 455                                 R
## 456                                 R
## 457                                 R
## 458                                 R
## 459                                 R
##     Party.fctr.RFE.X.scale.rcv.glmnet.prob
## 454                              0.7424880
## 455                              0.7929111
## 456                              0.7632908
## 457                              0.7639110
## 458                              0.8063896
## 459                              0.7821974
##     Party.fctr.RFE.X.scale.rcv.glmnet.is.acc
## 454                                    FALSE
## 455                                    FALSE
## 456                                    FALSE
## 457                                    FALSE
## 458                                    FALSE
## 459                                    FALSE
##     Party.fctr.RFE.X.scale.rcv.glmnet.err
## 454                                  TRUE
## 455                                  TRUE
## 456                                  TRUE
## 457                                  TRUE
## 458                                  TRUE
## 459                                  TRUE
##     Party.fctr.RFE.X.scale.rcv.glmnet.err.abs
## 454                                 0.7424880
## 455                                 0.7929111
## 456                                 0.7632908
## 457                                 0.7639110
## 458                                 0.8063896
## 459                                 0.7821974
##     Party.fctr.RFE.X.center.rcv.glmnet
## 454                                  R
## 455                                  R
## 456                                  R
## 457                                  R
## 458                                  R
## 459                                  R
##     Party.fctr.RFE.X.center.rcv.glmnet.prob
## 454                               0.7424880
## 455                               0.7929111
## 456                               0.7632908
## 457                               0.7639110
## 458                               0.8063896
## 459                               0.7821974
##     Party.fctr.RFE.X.center.rcv.glmnet.is.acc
## 454                                     FALSE
## 455                                     FALSE
## 456                                     FALSE
## 457                                     FALSE
## 458                                     FALSE
## 459                                     FALSE
##     Party.fctr.RFE.X.center.rcv.glmnet.err
## 454                                   TRUE
## 455                                   TRUE
## 456                                   TRUE
## 457                                   TRUE
## 458                                   TRUE
## 459                                   TRUE
##     Party.fctr.RFE.X.center.rcv.glmnet.err.abs
## 454                                  0.7424880
## 455                                  0.7929111
## 456                                  0.7632908
## 457                                  0.7639110
## 458                                  0.8063896
## 459                                  0.7821974
##     Party.fctr.All.X.scale.rcv.glmnet
## 454                                 R
## 455                                 R
## 456                                 R
## 457                                 R
## 458                                 R
## 459                                 R
##     Party.fctr.All.X.scale.rcv.glmnet.prob
## 454                              0.7424880
## 455                              0.7929111
## 456                              0.7632908
## 457                              0.7639110
## 458                              0.8063896
## 459                              0.7821974
##     Party.fctr.All.X.scale.rcv.glmnet.is.acc
## 454                                    FALSE
## 455                                    FALSE
## 456                                    FALSE
## 457                                    FALSE
## 458                                    FALSE
## 459                                    FALSE
##     Party.fctr.All.X.scale.rcv.glmnet.err
## 454                                  TRUE
## 455                                  TRUE
## 456                                  TRUE
## 457                                  TRUE
## 458                                  TRUE
## 459                                  TRUE
##     Party.fctr.All.X.scale.rcv.glmnet.err.abs
## 454                                 0.7424880
## 455                                 0.7929111
## 456                                 0.7632908
## 457                                 0.7639110
## 458                                 0.8063896
## 459                                 0.7821974
##     Party.fctr.All.X.center.rcv.glmnet
## 454                                  R
## 455                                  R
## 456                                  R
## 457                                  R
## 458                                  R
## 459                                  R
##     Party.fctr.All.X.center.rcv.glmnet.prob
## 454                               0.7424880
## 455                               0.7929111
## 456                               0.7632908
## 457                               0.7639110
## 458                               0.8063896
## 459                               0.7821974
##     Party.fctr.All.X.center.rcv.glmnet.is.acc
## 454                                     FALSE
## 455                                     FALSE
## 456                                     FALSE
## 457                                     FALSE
## 458                                     FALSE
## 459                                     FALSE
##     Party.fctr.All.X.center.rcv.glmnet.err
## 454                                   TRUE
## 455                                   TRUE
## 456                                   TRUE
## 457                                   TRUE
## 458                                   TRUE
## 459                                   TRUE
##     Party.fctr.All.X.center.rcv.glmnet.err.abs
## 454                                  0.7424880
## 455                                  0.7929111
## 456                                  0.7632908
## 457                                  0.7639110
## 458                                  0.8063896
## 459                                  0.7821974
##     Party.fctr.RFE.X.range.rcv.glmnet
## 454                                 R
## 455                                 R
## 456                                 R
## 457                                 R
## 458                                 R
## 459                                 R
##     Party.fctr.RFE.X.range.rcv.glmnet.prob
## 454                              0.7424880
## 455                              0.7929111
## 456                              0.7632908
## 457                              0.7639110
## 458                              0.8063896
## 459                              0.7821974
##     Party.fctr.RFE.X.range.rcv.glmnet.is.acc
## 454                                    FALSE
## 455                                    FALSE
## 456                                    FALSE
## 457                                    FALSE
## 458                                    FALSE
## 459                                    FALSE
##     Party.fctr.RFE.X.range.rcv.glmnet.err
## 454                                  TRUE
## 455                                  TRUE
## 456                                  TRUE
## 457                                  TRUE
## 458                                  TRUE
## 459                                  TRUE
##     Party.fctr.RFE.X.range.rcv.glmnet.err.abs
## 454                                 0.7424880
## 455                                 0.7929111
## 456                                 0.7632908
## 457                                 0.7639110
## 458                                 0.8063896
## 459                                 0.7821974
##     Party.fctr.RFE.X.BoxCox.rcv.glmnet
## 454                                  R
## 455                                  R
## 456                                  R
## 457                                  R
## 458                                  R
## 459                                  R
##     Party.fctr.RFE.X.BoxCox.rcv.glmnet.prob
## 454                               0.7424880
## 455                               0.7929111
## 456                               0.7632908
## 457                               0.7639110
## 458                               0.8063896
## 459                               0.7821974
##     Party.fctr.RFE.X.BoxCox.rcv.glmnet.is.acc
## 454                                     FALSE
## 455                                     FALSE
## 456                                     FALSE
## 457                                     FALSE
## 458                                     FALSE
## 459                                     FALSE
##     Party.fctr.RFE.X.BoxCox.rcv.glmnet.err
## 454                                   TRUE
## 455                                   TRUE
## 456                                   TRUE
## 457                                   TRUE
## 458                                   TRUE
## 459                                   TRUE
##     Party.fctr.RFE.X.BoxCox.rcv.glmnet.err.abs
## 454                                  0.7424880
## 455                                  0.7929111
## 456                                  0.7632908
## 457                                  0.7639110
## 458                                  0.8063896
## 459                                  0.7821974
##     Party.fctr.All.X.range.rcv.glmnet
## 454                                 R
## 455                                 R
## 456                                 R
## 457                                 R
## 458                                 R
## 459                                 R
##     Party.fctr.All.X.range.rcv.glmnet.prob
## 454                              0.7424880
## 455                              0.7929111
## 456                              0.7632908
## 457                              0.7639110
## 458                              0.8063896
## 459                              0.7821974
##     Party.fctr.All.X.range.rcv.glmnet.is.acc
## 454                                    FALSE
## 455                                    FALSE
## 456                                    FALSE
## 457                                    FALSE
## 458                                    FALSE
## 459                                    FALSE
##     Party.fctr.All.X.range.rcv.glmnet.err
## 454                                  TRUE
## 455                                  TRUE
## 456                                  TRUE
## 457                                  TRUE
## 458                                  TRUE
## 459                                  TRUE
##     Party.fctr.All.X.range.rcv.glmnet.err.abs
## 454                                 0.7424880
## 455                                 0.7929111
## 456                                 0.7632908
## 457                                 0.7639110
## 458                                 0.8063896
## 459                                 0.7821974
##     Party.fctr.All.X.BoxCox.rcv.glmnet
## 454                                  R
## 455                                  R
## 456                                  R
## 457                                  R
## 458                                  R
## 459                                  R
##     Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## 454                               0.7424880
## 455                               0.7929111
## 456                               0.7632908
## 457                               0.7639110
## 458                               0.8063896
## 459                               0.7821974
##     Party.fctr.All.X.BoxCox.rcv.glmnet.is.acc
## 454                                     FALSE
## 455                                     FALSE
## 456                                     FALSE
## 457                                     FALSE
## 458                                     FALSE
## 459                                     FALSE
##     Party.fctr.All.X.BoxCox.rcv.glmnet.err
## 454                                   TRUE
## 455                                   TRUE
## 456                                   TRUE
## 457                                   TRUE
## 458                                   TRUE
## 459                                   TRUE
##     Party.fctr.All.X.BoxCox.rcv.glmnet.err.abs
## 454                                  0.7424880
## 455                                  0.7929111
## 456                                  0.7632908
## 457                                  0.7639110
## 458                                  0.8063896
## 459                                  0.7821974
##     Party.fctr.RFE.X.center.scale.rcv.glmnet
## 454                                        R
## 455                                        R
## 456                                        R
## 457                                        R
## 458                                        R
## 459                                        R
##     Party.fctr.RFE.X.center.scale.rcv.glmnet.prob
## 454                                     0.7424880
## 455                                     0.7929111
## 456                                     0.7632908
## 457                                     0.7639110
## 458                                     0.8063896
## 459                                     0.7821974
##     Party.fctr.RFE.X.center.scale.rcv.glmnet.is.acc
## 454                                           FALSE
## 455                                           FALSE
## 456                                           FALSE
## 457                                           FALSE
## 458                                           FALSE
## 459                                           FALSE
##     Party.fctr.RFE.X.center.scale.rcv.glmnet.err
## 454                                         TRUE
## 455                                         TRUE
## 456                                         TRUE
## 457                                         TRUE
## 458                                         TRUE
## 459                                         TRUE
##     Party.fctr.RFE.X.center.scale.rcv.glmnet.err.abs
## 454                                        0.7424880
## 455                                        0.7929111
## 456                                        0.7632908
## 457                                        0.7639110
## 458                                        0.8063896
## 459                                        0.7821974
##     Party.fctr.All.X.center.scale.rcv.glmnet
## 454                                        R
## 455                                        R
## 456                                        R
## 457                                        R
## 458                                        R
## 459                                        R
##     Party.fctr.All.X.center.scale.rcv.glmnet.prob
## 454                                     0.7424880
## 455                                     0.7929111
## 456                                     0.7632908
## 457                                     0.7639110
## 458                                     0.8063896
## 459                                     0.7821974
##     Party.fctr.All.X.center.scale.rcv.glmnet.is.acc
## 454                                           FALSE
## 455                                           FALSE
## 456                                           FALSE
## 457                                           FALSE
## 458                                           FALSE
## 459                                           FALSE
##     Party.fctr.All.X.center.scale.rcv.glmnet.err
## 454                                         TRUE
## 455                                         TRUE
## 456                                         TRUE
## 457                                         TRUE
## 458                                         TRUE
## 459                                         TRUE
##     Party.fctr.All.X.center.scale.rcv.glmnet.err.abs
## 454                                        0.7424880
## 455                                        0.7929111
## 456                                        0.7632908
## 457                                        0.7639110
## 458                                        0.8063896
## 459                                        0.7821974
##     Party.fctr.All.X.zv.pca.rcv.glmnet
## 454                                  R
## 455                                  R
## 456                                  R
## 457                                  R
## 458                                  R
## 459                                  R
##     Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## 454                               0.7797343
## 455                               0.7562057
## 456                               0.7452304
## 457                               0.7601074
## 458                               0.8185298
## 459                               0.8421323
##     Party.fctr.All.X.zv.pca.rcv.glmnet.is.acc
## 454                                     FALSE
## 455                                     FALSE
## 456                                     FALSE
## 457                                     FALSE
## 458                                     FALSE
## 459                                     FALSE
##     Party.fctr.All.X.zv.pca.rcv.glmnet.err
## 454                                   TRUE
## 455                                   TRUE
## 456                                   TRUE
## 457                                   TRUE
## 458                                   TRUE
## 459                                   TRUE
##     Party.fctr.All.X.zv.pca.rcv.glmnet.err.abs Party.fctr.RFE.X..rcv.gbm
## 454                                  0.7797343                         R
## 455                                  0.7562057                         R
## 456                                  0.7452304                         R
## 457                                  0.7601074                         R
## 458                                  0.8185298                         R
## 459                                  0.8421323                         R
##     Party.fctr.RFE.X..rcv.gbm.prob Party.fctr.RFE.X..rcv.gbm.is.acc
## 454                      0.7534069                            FALSE
## 455                      0.7591033                            FALSE
## 456                      0.7332990                            FALSE
## 457                      0.7595692                            FALSE
## 458                      0.7784111                            FALSE
## 459                      0.7370606                            FALSE
##     Party.fctr.RFE.X..rcv.gbm.err Party.fctr.RFE.X..rcv.gbm.err.abs
## 454                          TRUE                         0.7534069
## 455                          TRUE                         0.7591033
## 456                          TRUE                         0.7332990
## 457                          TRUE                         0.7595692
## 458                          TRUE                         0.7784111
## 459                          TRUE                         0.7370606
##     Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet
## 454                                               R
## 455                                               R
## 456                                               R
## 457                                               R
## 458                                               R
## 459                                               R
##     Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.prob
## 454                                            0.6798692
## 455                                            0.7088661
## 456                                            0.6241034
## 457                                            0.6940021
## 458                                            0.7047010
## 459                                            0.6746674
##     Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.is.acc
## 454                                                  FALSE
## 455                                                  FALSE
## 456                                                  FALSE
## 457                                                  FALSE
## 458                                                  FALSE
## 459                                                  FALSE
##     Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.err
## 454                                                TRUE
## 455                                                TRUE
## 456                                                TRUE
## 457                                                TRUE
## 458                                                TRUE
## 459                                                TRUE
##     Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.err.abs
## 454                                               0.6798692
## 455                                               0.7088661
## 456                                               0.6241034
## 457                                               0.6940021
## 458                                               0.7047010
## 459                                               0.6746674
##     Party.fctr.RFE.X..rcv.earth Party.fctr.RFE.X..rcv.earth.prob
## 454                           R                        0.8127665
## 455                           R                        0.8398609
## 456                           R                        0.8127665
## 457                           R                        0.8345596
## 458                           R                        0.8659633
## 459                           R                        0.8324029
##     Party.fctr.RFE.X..rcv.earth.is.acc Party.fctr.RFE.X..rcv.earth.err
## 454                              FALSE                            TRUE
## 455                              FALSE                            TRUE
## 456                              FALSE                            TRUE
## 457                              FALSE                            TRUE
## 458                              FALSE                            TRUE
## 459                              FALSE                            TRUE
##     Party.fctr.RFE.X..rcv.earth.err.abs Party.fctr.RFE.X..rcv.glm
## 454                           0.8127665                         R
## 455                           0.8398609                         R
## 456                           0.8127665                         R
## 457                           0.8345596                         R
## 458                           0.8659633                         R
## 459                           0.8324029                         R
##     Party.fctr.RFE.X..rcv.glm.prob Party.fctr.RFE.X..rcv.glm.is.acc
## 454                      0.8986700                            FALSE
## 455                      0.7871710                            FALSE
## 456                      0.8552586                            FALSE
## 457                      0.8035760                            FALSE
## 458                      0.9121924                            FALSE
## 459                      0.9706172                            FALSE
##     Party.fctr.RFE.X..rcv.glm.err Party.fctr.RFE.X..rcv.glm.err.abs
## 454                          TRUE                         0.8986700
## 455                          TRUE                         0.7871710
## 456                          TRUE                         0.8552586
## 457                          TRUE                         0.8035760
## 458                          TRUE                         0.9121924
## 459                          TRUE                         0.9706172
##     Party.fctr.All.X..rcv.glm Party.fctr.All.X..rcv.glm.prob
## 454                         R                      0.8965899
## 455                         R                      0.7904827
## 456                         R                      0.8510400
## 457                         R                      0.7980782
## 458                         R                      0.9153599
## 459                         R                      0.9763278
##     Party.fctr.All.X..rcv.glm.is.acc Party.fctr.All.X..rcv.glm.err
## 454                            FALSE                          TRUE
## 455                            FALSE                          TRUE
## 456                            FALSE                          TRUE
## 457                            FALSE                          TRUE
## 458                            FALSE                          TRUE
## 459                            FALSE                          TRUE
##     Party.fctr.All.X..rcv.glm.err.abs Party.fctr.RFE.X..rcv.rf
## 454                         0.8965899                        D
## 455                         0.7904827                        R
## 456                         0.8510400                        R
## 457                         0.7980782                        R
## 458                         0.9153599                        R
## 459                         0.9763278                        D
##     Party.fctr.RFE.X..rcv.rf.prob Party.fctr.RFE.X..rcv.rf.is.acc
## 454                         0.644                            TRUE
## 455                         0.748                           FALSE
## 456                         0.798                           FALSE
## 457                         0.756                           FALSE
## 458                         0.706                           FALSE
## 459                         0.634                            TRUE
##     Party.fctr.RFE.X..rcv.rf.err Party.fctr.RFE.X..rcv.rf.err.abs
## 454                        FALSE                            0.644
## 455                         TRUE                            0.748
## 456                         TRUE                            0.798
## 457                         TRUE                            0.756
## 458                         TRUE                            0.706
## 459                        FALSE                            0.634
##     Party.fctr.RFE.X..rcv.avNNet Party.fctr.RFE.X..rcv.avNNet.prob
## 454                            R                         0.7823527
## 455                            R                         0.7823527
## 456                            R                         0.7823527
## 457                            R                         0.7823527
## 458                            R                         0.7823527
## 459                            R                         0.7823527
##     Party.fctr.RFE.X..rcv.avNNet.is.acc Party.fctr.RFE.X..rcv.avNNet.err
## 454                               FALSE                             TRUE
## 455                               FALSE                             TRUE
## 456                               FALSE                             TRUE
## 457                               FALSE                             TRUE
## 458                               FALSE                             TRUE
## 459                               FALSE                             TRUE
##     Party.fctr.RFE.X..rcv.avNNet.err.abs Party.fctr.RFE.X..rcv.nnet
## 454                            0.7823527                          R
## 455                            0.7823527                          D
## 456                            0.7823527                          R
## 457                            0.7823527                          R
## 458                            0.7823527                          R
## 459                            0.7823527                          R
##     Party.fctr.RFE.X..rcv.nnet.prob Party.fctr.RFE.X..rcv.nnet.is.acc
## 454                       0.7480819                             FALSE
## 455                       0.5494767                              TRUE
## 456                       0.7479254                             FALSE
## 457                       0.7478350                             FALSE
## 458                       0.7480898                             FALSE
## 459                       0.7480751                             FALSE
##     Party.fctr.RFE.X..rcv.nnet.err Party.fctr.RFE.X..rcv.nnet.err.abs
## 454                           TRUE                          0.7480819
## 455                          FALSE                          0.5494767
## 456                           TRUE                          0.7479254
## 457                           TRUE                          0.7478350
## 458                           TRUE                          0.7480898
## 459                           TRUE                          0.7480751
##     Party.fctr.RFE.X.ica.rcv.glmnet Party.fctr.RFE.X.ica.rcv.glmnet.prob
## 454                               D                            0.4664807
## 455                               D                            0.4884713
## 456                               D                            0.5336390
## 457                               D                            0.4441462
## 458                               R                            0.5783292
## 459                               D                            0.4079638
##     Party.fctr.RFE.X.ica.rcv.glmnet.is.acc
## 454                                   TRUE
## 455                                   TRUE
## 456                                   TRUE
## 457                                   TRUE
## 458                                  FALSE
## 459                                   TRUE
##     Party.fctr.RFE.X.ica.rcv.glmnet.err
## 454                               FALSE
## 455                               FALSE
## 456                               FALSE
## 457                               FALSE
## 458                                TRUE
## 459                               FALSE
##     Party.fctr.RFE.X.ica.rcv.glmnet.err.abs
## 454                               0.4664807
## 455                               0.4884713
## 456                               0.5336390
## 457                               0.4441462
## 458                               0.5783292
## 459                               0.4079638
##     Party.fctr.All.X.ica.rcv.glmnet Party.fctr.All.X.ica.rcv.glmnet.prob
## 454                               D                            0.4700762
## 455                               D                            0.4937098
## 456                               D                            0.5403660
## 457                               D                            0.4453674
## 458                               R                            0.5867802
## 459                               D                            0.4033130
##     Party.fctr.All.X.ica.rcv.glmnet.is.acc
## 454                                   TRUE
## 455                                   TRUE
## 456                                   TRUE
## 457                                   TRUE
## 458                                  FALSE
## 459                                   TRUE
##     Party.fctr.All.X.ica.rcv.glmnet.err
## 454                               FALSE
## 455                               FALSE
## 456                               FALSE
## 457                               FALSE
## 458                                TRUE
## 459                               FALSE
##     Party.fctr.All.X.ica.rcv.glmnet.err.abs
## 454                               0.4700762
## 455                               0.4937098
## 456                               0.5403660
## 457                               0.4453674
## 458                               0.5867802
## 459                               0.4033130
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet
## 454                                          D
## 455                                          D
## 456                                          D
## 457                                          D
## 458                                          R
## 459                                          R
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## 454                                       0.6472282
## 455                                       0.6174662
## 456                                       0.6523149
## 457                                       0.5772760
## 458                                       0.7743016
## 459                                       0.7198149
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.is.acc
## 454                                              TRUE
## 455                                              TRUE
## 456                                              TRUE
## 457                                              TRUE
## 458                                             FALSE
## 459                                             FALSE
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.err
## 454                                          FALSE
## 455                                          FALSE
## 456                                          FALSE
## 457                                          FALSE
## 458                                           TRUE
## 459                                           TRUE
##     Party.fctr.Interact.High.cor.Y..rcv.glmnet.err.abs
## 454                                          0.6472282
## 455                                          0.6174662
## 456                                          0.6523149
## 457                                          0.5772760
## 458                                          0.7743016
## 459                                          0.7198149
##     Party.fctr.Ensemble.auto.2..rcv.glmnet.prob
## 454                                   0.8381343
## 455                                   0.8471949
## 456                                   0.8565945
## 457                                   0.8722500
## 458                                   0.8773259
## 459                                   0.8984567
##     Party.fctr.Ensemble.auto.2..rcv.glmnet
## 454                                      R
## 455                                      R
## 456                                      R
## 457                                      R
## 458                                      R
## 459                                      R
##     Party.fctr.Ensemble.auto.2..rcv.glmnet.err
## 454                                       TRUE
## 455                                       TRUE
## 456                                       TRUE
## 457                                       TRUE
## 458                                       TRUE
## 459                                       TRUE
##     Party.fctr.Ensemble.auto.2..rcv.glmnet.err.abs
## 454                                      0.8381343
## 455                                      0.8471949
## 456                                      0.8565945
## 457                                      0.8722500
## 458                                      0.8773259
## 459                                      0.8984567
##     Party.fctr.Ensemble.auto.2..rcv.glmnet.is.acc
## 454                                         FALSE
## 455                                         FALSE
## 456                                         FALSE
## 457                                         FALSE
## 458                                         FALSE
## 459                                         FALSE
##     Party.fctr.Ensemble.auto.2..rcv.glmnet.accurate
## 454                                           FALSE
## 455                                           FALSE
## 456                                           FALSE
## 457                                           FALSE
## 458                                           FALSE
## 459                                           FALSE
##     Party.fctr.Ensemble.auto.2..rcv.glmnet.error
## 454                                    0.1881343
## 455                                    0.1971949
## 456                                    0.2065945
## 457                                    0.2222500
## 458                                    0.2273259
## 459                                    0.2484567

##     Q109244.fctr .n.OOB .n.Fit .n.Tst .freqRatio.Fit .freqRatio.OOB
## Yes          Yes    179    746    223      0.1675275      0.1605381
## NA            NA    438   1746    547      0.3920952      0.3928251
## No            No    498   1961    622      0.4403773      0.4466368
##     .freqRatio.Tst err.abs.fit.sum err.abs.fit.mean .n.fit err.abs.OOB.sum
## Yes      0.1602011        158.8865        0.2129845    746        84.95637
## NA       0.3929598        799.4847        0.4578950   1746       205.99749
## No       0.4468391        836.2324        0.4264316   1961       234.16301
##     err.abs.OOB.mean
## Yes        0.4746166
## NA         0.4703139
## No         0.4702069
##           .n.OOB           .n.Fit           .n.Tst   .freqRatio.Fit 
##      1115.000000      4453.000000      1392.000000         1.000000 
##   .freqRatio.OOB   .freqRatio.Tst  err.abs.fit.sum err.abs.fit.mean 
##         1.000000         1.000000      1794.603578         1.097311 
##           .n.fit  err.abs.OOB.sum err.abs.OOB.mean 
##      4453.000000       525.116866         1.415137
##              label step_major step_minor label_minor     bgn end elapsed
## 1 fit.models_2_bgn          1          0    teardown 428.014  NA      NA
##          label step_major step_minor label_minor     bgn     end elapsed
## 1 fit.models_2          1          0           0   7.063 428.025 420.962
## 2   fit.models          1          1           1 428.026      NA      NA
# if (sum(is.na(glbObsAll$D.P.http)) > 0)
#         stop("fit.models_3: Why is this happening ?")

#stop(here"); glb2Sav()
sync_glb_obs_df <- function() {
    # Merge or cbind ?
    for (col in setdiff(names(glbObsFit), names(glbObsTrn)))
        glbObsTrn[glbObsTrn$.lcn == "Fit", col] <<- glbObsFit[, col]
    for (col in setdiff(names(glbObsFit), names(glbObsAll)))
        glbObsAll[glbObsAll$.lcn == "Fit", col] <<- glbObsFit[, col]
    if (all(is.na(glbObsNew[, glb_rsp_var])))
        for (col in setdiff(names(glbObsOOB), names(glbObsTrn)))
            glbObsTrn[glbObsTrn$.lcn == "OOB", col] <<- glbObsOOB[, col]
    for (col in setdiff(names(glbObsOOB), names(glbObsAll)))
        glbObsAll[glbObsAll$.lcn == "OOB", col] <<- glbObsOOB[, col]
}
sync_glb_obs_df()
    
print(setdiff(names(glbObsNew), names(glbObsAll)))
## character(0)
replay.petrisim(pn = glb_analytics_pn, 
    replay.trans = (glb_analytics_avl_objs <- c(glb_analytics_avl_objs, 
        "model.selected")), flip_coord = TRUE)
## time trans    "bgn " "fit.data.training.all " "predict.data.new " "end " 
## 0.0000   multiple enabled transitions:  data.training.all data.new model.selected    firing:  model.selected 
## 1.0000    3   2 1 0 0

glb_chunks_df <- myadd_chunk(glb_chunks_df, "fit.data.training", major.inc = TRUE)
##               label step_major step_minor label_minor     bgn     end
## 2        fit.models          1          1           1 428.026 455.507
## 3 fit.data.training          2          0           0 455.508      NA
##   elapsed
## 2  27.482
## 3      NA

Step 2.0: fit data training

#load(paste0(glb_inp_pfx, "dsk.RData"))

if (!is.null(glbMdlFinId) && (glbMdlFinId %in% names(glb_models_lst))) {
    warning("Final model same as user selected model")
    glb_fin_mdl <- glb_models_lst[[glbMdlFinId]]
} else 
# if (nrow(glbObsFit) + length(glbObsFitOutliers) == nrow(glbObsTrn))
if (!all(is.na(glbObsNew[, glb_rsp_var]))) {    
    warning("Final model same as glbMdlSelId")
    glbMdlFinId <- paste0("Final.", glbMdlSelId)
    glb_fin_mdl <- glb_sel_mdl
    glb_models_lst[[glbMdlFinId]] <- glb_fin_mdl
    mdlDf <- glb_models_df[glb_models_df$id == glbMdlSelId, ]
    mdlDf$id <- glbMdlFinId
    glb_models_df <- rbind(glb_models_df, mdlDf)
} else {    
    if (myparseMdlId(glbMdlSelId)$family == "RFE.X") {
        indepVar <- mygetIndepVar(glb_feats_df)
        trnRFEResults <- 
            myrun_rfe(glbObsTrn, indepVar, glbRFESizes[["Final"]])
        if (!isTRUE(all.equal(sort(predictors(trnRFEResults)),
                              sort(predictors(glbRFEResults))))) {
            print("Diffs predictors(trnRFEResults) vs. predictors(glbRFEResults):")
            print(setdiff(predictors(trnRFEResults), predictors(glbRFEResults)))
            print("Diffs predictors(glbRFEResults) vs. predictors(trnRFEResults):")
            print(setdiff(predictors(glbRFEResults), predictors(trnRFEResults)))
        }
    }

    if (grepl("Ensemble", glbMdlSelId)) {
        # Find which models are relevant
        mdlimp_df <- subset(myget_feats_importance(glb_sel_mdl), imp > 5)
        mdlIndepVar <- row.names(mdlimp_df)
        if (glb_is_classification)
            mdlIdVcr <- glbMdlEnsemble[sapply(glbMdlEnsemble, function(thsMdlId)
                            mygetPredictIds(glb_rsp_var, thsMdlId)$prob  %in% mdlIndepVar)] else
            mdlIdVcr <- glbMdlEnsemble[sapply(glbMdlEnsemble, function(thsMdlId)
                            mygetPredictIds(glb_rsp_var, thsMdlId)$value %in% mdlIndepVar)]
        # Fit selected models on glbObsTrn
        for (mdl_id in mdlIdVcr) {
            mdl_id_components <- myparseMdlId(mdl_id)
            mdlIdPfx <- mdl_id_components$family
            # if (grepl("RFE\\.X\\.", mdlIdPfx)) 
            #     mdlIndepVars <- myadjustInteractionFeats(glb_feats_df, myextract_actual_feats(
            #         predictors(trnRFEResults))) else
                # mdlIndepVars <- trim(unlist(
                #     strsplit(glb_models_df[glb_models_df$id == mdl_id, "feats"], "[,]")))
            thsIndepVar <- unlist(
                    strsplit(glb_models_df[glb_models_df$id == mdl_id, "feats"], "[,]"))
            thsSpc <- myinit_mdl_specs_lst(mdl_specs_lst = list(
                        id.prefix = paste0("Final.", mdlIdPfx), 
                        type = glb_model_type, tune.df = glbMdlTuneParams,
                        trainControl.method = mdl_id_components$resample,
                        trainControl.number = glb_rcv_n_folds,
                        trainControl.repeats = glb_rcv_n_repeats,
                        trainControl.classProbs = glb_is_classification,
                        trainControl.summaryFunction = glbMdlMetricSummaryFn,
                        trainControl.allowParallel = glbMdlAllowParallel,
                        train.metric = glbMdlMetricSummary, 
                        train.maximize = glbMdlMetricMaximize,    
                        train.method = mdl_id_components$alg,
                        train.preProcess = mdl_id_components$preProcess))
            ret_lst <- myfit_mdl(mdl_specs_lst = thsSpc,
                    indepVar = thsIndepVar,
                    rsp_var = glb_rsp_var, 
                    fit_df = glbObsTrn, OOB_df = NULL)
            
            glbObsTrn <- glb_get_predictions(df = glbObsTrn,
                                                mdl_id = thsSpc$id, 
                                                rsp_var = glb_rsp_var,
                                                prob_threshold_def = 
                    subset(glb_models_df, id == mdl_id)$opt.prob.threshold.OOB)
            glbObsNew <- glb_get_predictions(df = glbObsNew,
                                                mdl_id = thsSpc$id, 
                                                rsp_var = glb_rsp_var,
                                                prob_threshold_def = 
                    subset(glb_models_df, id == mdl_id)$opt.prob.threshold.OOB)
        }    
    }
    
    # "Final" model
    if ((model_method <- glb_sel_mdl$method) == "custom")
        # get actual method from the mdl_id
        model_method <- tail(unlist(strsplit(glbMdlSelId, "[.]")), 1)
        
    if (grepl("Ensemble", glbMdlSelId)) {
        # Find which models are relevant
        mdlimp_df <- subset(myget_feats_importance(glb_sel_mdl), imp > 5)
        mdlIndepVar <- row.names(mdlimp_df)        
        if (glb_is_classification)
            mdlIdVcr <- glbMdlEnsemble[sapply(glbMdlEnsemble, function(thsMdlId)
                            mygetPredictIds(glb_rsp_var, thsMdlId)$prob  %in% mdlIndepVar)] else
            mdlIdVcr <- glbMdlEnsemble[sapply(glbMdlEnsemble, function(thsMdlId)
                            mygetPredictIds(glb_rsp_var, thsMdlId)$value %in% mdlIndepVar)]
        mdlIdVcr <- paste("Final", mdlIdVcr, sep = ".")
        mdlIndepVar <- gsub(glb_rsp_var, paste0(glb_rsp_var, ".Final"), mdlIndepVar, fixed = TRUE)
        
        # if (glb_is_classification && glb_is_binomial)
        #     indepVar <- gsub("(.*)\\.(.*)\\.prob", "\\1\\.Train\\.\\2\\.prob",
        #                             row.names(mdlimp_df)) else
        #     indepVar <- gsub("(.*)\\.(.*)", "\\1\\.Train\\.\\2",
        #                             row.names(mdlimp_df))
    } else 
    if (grepl("RFE.X", glbMdlSelId, fixed = TRUE)) {
        # indepVar <- myextract_actual_feats(predictors(trnRFEResults))
        mdlIndepVar <- myextract_actual_feats(predictors(glbRFEResults))        
    } else mdlIndepVar <- 
                trim(unlist(strsplit(glb_models_df[glb_models_df$id ==
                                                   glbMdlSelId
                                                   , "feats"], "[,]")))
        
    # if (!is.null(glbMdlPreprocMethods) &&
    #     ((match_pos <- regexpr(gsub(".", "\\.", 
    #                                 paste(glbMdlPreprocMethods, collapse = "|"),
    #                                fixed = TRUE), glbMdlSelId)) != -1))
    #     ths_preProcess <- str_sub(glbMdlSelId, match_pos, 
    #                             match_pos + attr(match_pos, "match.length") - 1) else
    #     ths_preProcess <- NULL   
    
    # mdl_id_pfx <- ifelse(grepl("Ensemble", glbMdlSelId),
    #                                "Final.Ensemble", "Final")
    thsMdlId <- paste0("Final.", glbMdlSelId)
    thsMdlIdComponents <- myparseMdlId(thsMdlId)
    # mdl_id_pfx <- paste("Final", myparseMdlId(glbMdlSelId)$family, sep = ".")
    mdl_id_pfx <- thsMdlIdComponents$family
    
    trnobs_df <- glbObsTrn 
    if (!is.null(glbObsTrnOutliers[[mdl_id_pfx]])) {
        trnobs_df <- glbObsTrn[!(glbObsTrn[, glbFeatsId] %in% glbObsTrnOutliers[[mdl_id_pfx]]), ]
        print(sprintf("Outliers removed: %d", nrow(glbObsTrn) - nrow(trnobs_df)))
        print(setdiff(glbObsTrn[, glbFeatsId], trnobs_df[, glbFeatsId]))
    }    
        
    # Force fitting of Final.glm to identify outliers
    # method_vctr <- unique(c(myparseMdlId(glbMdlSelId)$alg, glbMdlFamilies[["Final"]]))

    thsSpc <- myinit_mdl_specs_lst(mdl_specs_lst = list(
        id.prefix = mdl_id_pfx, 
        type = glb_model_type, tune.df = glbMdlTuneParams,
        trainControl.method = thsMdlIdComponents$resample,
        trainControl.number = glb_rcv_n_folds,
        trainControl.repeats = glb_rcv_n_repeats,
        trainControl.classProbs = glb_is_classification,
        trainControl.summaryFunction = glbMdlMetricSummaryFn,
        trainControl.allowParallel = glbMdlAllowParallel,
        train.metric = glbMdlMetricSummary, 
        train.maximize = glbMdlMetricMaximize,    
        train.method = thsMdlIdComponents$alg,
        train.preProcess = thsMdlIdComponents$preProcess))

    glbMdlFinId <- thsSpc$id
    if (!(grepl("Ensemble", glbMdlSelId)))
        ret_lst <- myfit_mdl(mdl_specs_lst = thsSpc,
                             indepVar = mdlIndepVar,
                             rsp_var = glb_rsp_var, 
                             fit_df = glbObsTrn, OOB_df = NULL) else {
                                 
        # Final model same as selected model except for the model features
        tmp_models_df <- glb_models_df[glb_models_df$id == glbMdlSelId, ]
        tmp_models_df$id <- paste0("Final.", tmp_models_df$id)
        row.names(tmp_models_df) <- tmp_models_df$id
        tmp_models_df$feats <- gsub(glb_rsp_var, paste0(glb_rsp_var, ".Final"),
                                    tmp_models_df$feats, fixed = TRUE)
        glb_models_df <- rbind(glb_models_df, tmp_models_df)
        
        tmp_fin_mdl <- glb_sel_mdl
        # tmp_fin_mdl$coefnames <- gsub(glb_rsp_var, paste0(glb_rsp_var, ".Final"),
        #                               tmp_fin_mdl$coefnames, fixed = TRUE)
        # dimnames(tmp_fin_mdl$finalModel$beta)[[1]] <- 
        #     gsub(glb_rsp_var, paste0(glb_rsp_var, ".Final"),
        #         dimnames(tmp_fin_mdl$finalModel$beta)[[1]], fixed = TRUE)
        # tmp_fin_mdl$finalModel$xNames <- 
        #     gsub(glb_rsp_var, paste0(glb_rsp_var, ".Final"),
        #         tmp_fin_mdl$finalModel$xNames, fixed = TRUE)
        # 
        # thsAts <- attributes(tmp_fin_mdl$terms)
        # # thsAts$variables <- class == "call" & objects / symbols are stored as a formula
        # thsAts$term.labels <- 
        #     gsub(glb_rsp_var, paste0(glb_rsp_var, ".Final"),
        #         thsAts$term.labels, fixed = TRUE)
        # attributes(tmp_fin_mdl$terms) <- thsAts
        # 
        glb_models_lst[[glbMdlFinId]] <- tmp_fin_mdl
    }
    
    glb_fin_mdl <- glb_models_lst[[glbMdlFinId]] 
}
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Final.RFE.X.Inc##rcv#bagEarth"
## [1] "    indepVar: Q121011.fctr,Gender.fctr,Q100010.fctr,Q100562.fctr,Q100680.fctr,Q101162.fctr,Q101596.fctr,Q102089.fctr,Q102289.fctr,Q102687.fctr,Q102906.fctr,Q103293.fctr,Q105655.fctr,Q105840.fctr,Q106042.fctr,Q106272.fctr,Q106388.fctr,Q106389.fctr,Q106993.fctr,Q107491.fctr,Q107869.fctr,Q108617.fctr,Q108754.fctr,Q108855.fctr,Q108856.fctr,Q108950.fctr,Q109367.fctr,Q110740.fctr,Q111220.fctr,Q111580.fctr,Q111848.fctr,Q112270.fctr,Q112478.fctr,Q112512.fctr,Q113583.fctr,Q113584.fctr,Q113992.fctr,Q114152.fctr,Q114386.fctr,Q114517.fctr,Q114748.fctr,Q114961.fctr,Q115195.fctr,Q115390.fctr,Q115602.fctr,Q115610.fctr,Q115777.fctr,Q115899.fctr,Q116197.fctr,Q116441.fctr,Q116448.fctr,Q116601.fctr,Q116797.fctr,Q116953.fctr,Q117186.fctr,Q117193.fctr,Q118117.fctr,Q118232.fctr,Q118233.fctr,Q118237.fctr,Q118892.fctr,Q119851.fctr,Q120012.fctr,Q120014.fctr,Q120194.fctr,Q120472.fctr,Q120650.fctr,Q120978.fctr,Q121700.fctr,Q122120.fctr,Q122769.fctr,Q122770.fctr,Q123464.fctr,Q124742.fctr,Q96024.fctr,Q98078.fctr,Q98578.fctr,Q98869.fctr,Q99480.fctr,Q99581.fctr,Q99716.fctr,Q99982.fctr,Q109244.fctr*Q98197.fctr,Q109244.fctr*Q115611.fctr,Q109244.fctr*Q116881.fctr,Q109244.fctr*Q113181.fctr,Q109244.fctr*Hhold.fctr,Q109244.fctr*Edn.fctr,Q109244.fctr*Q108342.fctr,Q109244.fctr*Q106997.fctr,Q109244.fctr*Q100689.fctr,Q109244.fctr*Q119334.fctr,Q109244.fctr*Q122771.fctr,Q109244.fctr*Q119650.fctr,Q109244.fctr*Q124122.fctr,Q109244.fctr*Income.fctr,Q109244.fctr*Q123621.fctr,Q109244.fctr*Q121699.fctr,Q109244.fctr*Q102674.fctr,Q109244.fctr*Q108343.fctr,Q109244.fctr*Q120379.fctr,Q109244.fctr*Q101163.fctr,Q109244.fctr*Q104996.fctr,Q109244.fctr*YOB.Age.fctr,YOB.Age.fctr:YOB.Age.dff,Q109244.fctr:.clusterid.fctr"
## [1] "myfit_mdl: setup complete: 0.712000 secs"
## Loading required package: earth
## Loading required package: plotmo
## Loading required package: plotrix
## 
## Attaching package: 'plotrix'
## The following object is masked from 'package:gplots':
## 
##     plotCI
## Loading required package: TeachingDemos
## Fitting degree = 1, nprune = 256 on full training set
## [1] "myfit_mdl: train complete: 1095.363000 secs"
##   degree nprune
## 1      1    256
## [1] "myprint_mdl: B:"
## [1] 50
## [1] "myprint_mdl: oob:"
##        Accuracy     Kappa
##  [1,] 0.5859717 0.1695798
##  [2,] 0.6007715 0.1986927
##  [3,] 0.6113005 0.2226901
##  [4,] 0.5970370 0.1922396
##  [5,] 0.6223639 0.2390287
##  [6,] 0.6156863 0.2255373
##  [7,] 0.6131748 0.2224871
##  [8,] 0.6062954 0.2073296
##  [9,] 0.6022341 0.1976002
## [10,] 0.6170744 0.2278044
## [11,] 0.6289062 0.2540499
## [12,] 0.6106538 0.2207949
## [13,] 0.6049086 0.2055413
## [14,] 0.6138469 0.2158068
## [15,] 0.6030754 0.2023505
## [16,] 0.6088846 0.2105271
## [17,] 0.5985258 0.1943359
## [18,] 0.6156863 0.2291914
## [19,] 0.6063882 0.2100511
## [20,] 0.6035560 0.2012505
## [21,] 0.6105980 0.2204105
## [22,] 0.6168675 0.2261534
## [23,] 0.5976562 0.1931310
## [24,] 0.5927184 0.1798709
## [25,] 0.6199408 0.2336442
## [26,] 0.6077186 0.2115514
## [27,] 0.6072134 0.2109351
## [28,] 0.5936893 0.1835693
## [29,] 0.6023335 0.1991736
## [30,] 0.6016659 0.1980524
## [31,] 0.6204878 0.2376377
## [32,] 0.6085022 0.2090017
## [33,] 0.6217009 0.2406001
## [34,] 0.6045389 0.2054515
## [35,] 0.6208955 0.2310473
## [36,] 0.6047758 0.2050463
## [37,] 0.5990220 0.1955825
## [38,] 0.6108685 0.2181927
## [39,] 0.6190476 0.2325471
## [40,] 0.6315276 0.2571756
## [41,] 0.5924287 0.1810330
## [42,] 0.6033058 0.2071765
## [43,] 0.5821782 0.1587628
## [44,] 0.6048662 0.2063290
## [45,] 0.5979779 0.1916318
## [46,] 0.5945815 0.1837278
## [47,] 0.5980440 0.1916125
## [48,] 0.5960591 0.1873975
## [49,] 0.6261307 0.2446832
## [50,] 0.6019656 0.1988687
## [1] "myprint_mdl: levels:"
## [1] "D" "R"
## [1] "myprint_mdl: weights:"
## [1] TRUE
## [1] "myprint_mdl: xNames:"
##   [1] "Gender.fctrF"                         
##   [2] "Gender.fctrM"                         
##   [3] "Q100010.fctrNo"                       
##   [4] "Q100010.fctrYes"                      
##   [5] "Q100562.fctrNo"                       
##   [6] "Q100562.fctrYes"                      
##   [7] "Q100680.fctrNo"                       
##   [8] "Q100680.fctrYes"                      
##   [9] "Q101162.fctrOptimist"                 
##  [10] "Q101162.fctrPessimist"                
##  [11] "Q101596.fctrNo"                       
##  [12] "Q101596.fctrYes"                      
##  [13] "Q102089.fctrOwn"                      
##  [14] "Q102089.fctrRent"                     
##  [15] "Q102289.fctrNo"                       
##  [16] "Q102289.fctrYes"                      
##  [17] "Q102687.fctrNo"                       
##  [18] "Q102687.fctrYes"                      
##  [19] "Q102906.fctrNo"                       
##  [20] "Q102906.fctrYes"                      
##  [21] "Q103293.fctrNo"                       
##  [22] "Q103293.fctrYes"                      
##  [23] "Q105655.fctrNo"                       
##  [24] "Q105655.fctrYes"                      
##  [25] "Q105840.fctrNo"                       
##  [26] "Q105840.fctrYes"                      
##  [27] "Q106042.fctrNo"                       
##  [28] "Q106042.fctrYes"                      
##  [29] "Q106272.fctrNo"                       
##  [30] "Q106272.fctrYes"                      
##  [31] "Q106388.fctrNo"                       
##  [32] "Q106388.fctrYes"                      
##  [33] "Q106389.fctrNo"                       
##  [34] "Q106389.fctrYes"                      
##  [35] "Q106993.fctrNo"                       
##  [36] "Q106993.fctrYes"                      
##  [37] "Q107491.fctrNo"                       
##  [38] "Q107491.fctrYes"                      
##  [39] "Q107869.fctrNo"                       
##  [40] "Q107869.fctrYes"                      
##  [41] "Q108617.fctrNo"                       
##  [42] "Q108617.fctrYes"                      
##  [43] "Q108754.fctrNo"                       
##  [44] "Q108754.fctrYes"                      
##  [45] "Q108855.fctrUmm..."                   
##  [46] "Q108855.fctrYes!"                     
##  [47] "Q108856.fctrSocialize"                
##  [48] "Q108856.fctrSpace"                    
##  [49] "Q108950.fctrCautious"                 
##  [50] "Q108950.fctrRisk-friendly"            
##  [51] "Q109244.fctrNo"                       
##  [52] "Q109244.fctrYes"                      
##  [53] "Edn.fctr.L"                           
##  [54] "Edn.fctr.Q"                           
##  [55] "Edn.fctr.C"                           
##  [56] "Edn.fctr^4"                           
##  [57] "Edn.fctr^5"                           
##  [58] "Edn.fctr^6"                           
##  [59] "Edn.fctr^7"                           
##  [60] "Hhold.fctrMKn"                        
##  [61] "Hhold.fctrMKy"                        
##  [62] "Hhold.fctrPKn"                        
##  [63] "Hhold.fctrPKy"                        
##  [64] "Hhold.fctrSKn"                        
##  [65] "Hhold.fctrSKy"                        
##  [66] "Income.fctr.L"                        
##  [67] "Income.fctr.Q"                        
##  [68] "Income.fctr.C"                        
##  [69] "Income.fctr^4"                        
##  [70] "Income.fctr^5"                        
##  [71] "Income.fctr^6"                        
##  [72] "Q100689.fctrNo"                       
##  [73] "Q100689.fctrYes"                      
##  [74] "Q101163.fctrDad"                      
##  [75] "Q101163.fctrMom"                      
##  [76] "Q102674.fctrNo"                       
##  [77] "Q102674.fctrYes"                      
##  [78] "Q104996.fctrNo"                       
##  [79] "Q104996.fctrYes"                      
##  [80] "Q106997.fctrGr"                       
##  [81] "Q106997.fctrYy"                       
##  [82] "Q108342.fctrIn-person"                
##  [83] "Q108342.fctrOnline"                   
##  [84] "Q108343.fctrNo"                       
##  [85] "Q108343.fctrYes"                      
##  [86] "Q113181.fctrNo"                       
##  [87] "Q113181.fctrYes"                      
##  [88] "Q115611.fctrNo"                       
##  [89] "Q115611.fctrYes"                      
##  [90] "Q116881.fctrHappy"                    
##  [91] "Q116881.fctrRight"                    
##  [92] "Q119334.fctrNo"                       
##  [93] "Q119334.fctrYes"                      
##  [94] "Q119650.fctrGiving"                   
##  [95] "Q119650.fctrReceiving"                
##  [96] "Q120379.fctrNo"                       
##  [97] "Q120379.fctrYes"                      
##  [98] "Q121699.fctrNo"                       
##  [99] "Q121699.fctrYes"                      
## [100] "Q122771.fctrPc"                       
## [101] "Q122771.fctrPt"                       
## [102] "Q123621.fctrNo"                       
## [103] "Q123621.fctrYes"                      
## [104] "Q124122.fctrNo"                       
## [105] "Q124122.fctrYes"                      
## [106] "Q98197.fctrNo"                        
## [107] "Q98197.fctrYes"                       
## [108] "YOB.Age.fctr.L"                       
## [109] "YOB.Age.fctr.Q"                       
## [110] "YOB.Age.fctr.C"                       
## [111] "YOB.Age.fctr^4"                       
## [112] "YOB.Age.fctr^5"                       
## [113] "YOB.Age.fctr^6"                       
## [114] "YOB.Age.fctr^7"                       
## [115] "YOB.Age.fctr^8"                       
## [116] "Q109367.fctrNo"                       
## [117] "Q109367.fctrYes"                      
## [118] "Q110740.fctrMac"                      
## [119] "Q110740.fctrPC"                       
## [120] "Q111220.fctrNo"                       
## [121] "Q111220.fctrYes"                      
## [122] "Q111580.fctrDemanding"                
## [123] "Q111580.fctrSupportive"               
## [124] "Q111848.fctrNo"                       
## [125] "Q111848.fctrYes"                      
## [126] "Q112270.fctrNo"                       
## [127] "Q112270.fctrYes"                      
## [128] "Q112478.fctrNo"                       
## [129] "Q112478.fctrYes"                      
## [130] "Q112512.fctrNo"                       
## [131] "Q112512.fctrYes"                      
## [132] "Q113583.fctrTalk"                     
## [133] "Q113583.fctrTunes"                    
## [134] "Q113584.fctrPeople"                   
## [135] "Q113584.fctrTechnology"               
## [136] "Q113992.fctrNo"                       
## [137] "Q113992.fctrYes"                      
## [138] "Q114152.fctrNo"                       
## [139] "Q114152.fctrYes"                      
## [140] "Q114386.fctrMysterious"               
## [141] "Q114386.fctrTMI"                      
## [142] "Q114517.fctrNo"                       
## [143] "Q114517.fctrYes"                      
## [144] "Q114748.fctrNo"                       
## [145] "Q114748.fctrYes"                      
## [146] "Q114961.fctrNo"                       
## [147] "Q114961.fctrYes"                      
## [148] "Q115195.fctrNo"                       
## [149] "Q115195.fctrYes"                      
## [150] "Q115390.fctrNo"                       
## [151] "Q115390.fctrYes"                      
## [152] "Q115602.fctrNo"                       
## [153] "Q115602.fctrYes"                      
## [154] "Q115610.fctrNo"                       
## [155] "Q115610.fctrYes"                      
## [156] "Q115777.fctrEnd"                      
## [157] "Q115777.fctrStart"                    
## [158] "Q115899.fctrCs"                       
## [159] "Q115899.fctrMe"                       
## [160] "Q116197.fctrA.M."                     
## [161] "Q116197.fctrP.M."                     
## [162] "Q116441.fctrNo"                       
## [163] "Q116441.fctrYes"                      
## [164] "Q116448.fctrNo"                       
## [165] "Q116448.fctrYes"                      
## [166] "Q116601.fctrNo"                       
## [167] "Q116601.fctrYes"                      
## [168] "Q116797.fctrNo"                       
## [169] "Q116797.fctrYes"                      
## [170] "Q116953.fctrNo"                       
## [171] "Q116953.fctrYes"                      
## [172] "Q117186.fctrCool headed"              
## [173] "Q117186.fctrHot headed"               
## [174] "Q117193.fctrOdd hours"                
## [175] "Q117193.fctrStandard hours"           
## [176] "Q118117.fctrNo"                       
## [177] "Q118117.fctrYes"                      
## [178] "Q118232.fctrId"                       
## [179] "Q118232.fctrPr"                       
## [180] "Q118233.fctrNo"                       
## [181] "Q118233.fctrYes"                      
## [182] "Q118237.fctrNo"                       
## [183] "Q118237.fctrYes"                      
## [184] "Q118892.fctrNo"                       
## [185] "Q118892.fctrYes"                      
## [186] "Q119851.fctrNo"                       
## [187] "Q119851.fctrYes"                      
## [188] "Q120012.fctrNo"                       
## [189] "Q120012.fctrYes"                      
## [190] "Q120014.fctrNo"                       
## [191] "Q120014.fctrYes"                      
## [192] "Q120194.fctrStudy first"              
## [193] "Q120194.fctrTry first"                
## [194] "Q120472.fctrArt"                      
## [195] "Q120472.fctrScience"                  
## [196] "Q120650.fctrNo"                       
## [197] "Q120650.fctrYes"                      
## [198] "Q120978.fctrNo"                       
## [199] "Q120978.fctrYes"                      
## [200] "Q121011.fctrNo"                       
## [201] "Q121011.fctrYes"                      
## [202] "Q121700.fctrNo"                       
## [203] "Q121700.fctrYes"                      
## [204] "Q122120.fctrNo"                       
## [205] "Q122120.fctrYes"                      
## [206] "Q122769.fctrNo"                       
## [207] "Q122769.fctrYes"                      
## [208] "Q122770.fctrNo"                       
## [209] "Q122770.fctrYes"                      
## [210] "Q123464.fctrNo"                       
## [211] "Q123464.fctrYes"                      
## [212] "Q124742.fctrNo"                       
## [213] "Q124742.fctrYes"                      
## [214] "Q96024.fctrNo"                        
## [215] "Q96024.fctrYes"                       
## [216] "Q98078.fctrNo"                        
## [217] "Q98078.fctrYes"                       
## [218] "Q98578.fctrNo"                        
## [219] "Q98578.fctrYes"                       
## [220] "Q98869.fctrNo"                        
## [221] "Q98869.fctrYes"                       
## [222] "Q99480.fctrNo"                        
## [223] "Q99480.fctrYes"                       
## [224] "Q99581.fctrNo"                        
## [225] "Q99581.fctrYes"                       
## [226] "Q99716.fctrNo"                        
## [227] "Q99716.fctrYes"                       
## [228] "Q99982.fctrCheck!"                    
## [229] "Q99982.fctrNope"                      
## [230] "Q109244.fctrNo:Edn.fctr.L"            
## [231] "Q109244.fctrYes:Edn.fctr.L"           
## [232] "Q109244.fctrNo:Edn.fctr.Q"            
## [233] "Q109244.fctrYes:Edn.fctr.Q"           
## [234] "Q109244.fctrNo:Edn.fctr.C"            
## [235] "Q109244.fctrYes:Edn.fctr.C"           
## [236] "Q109244.fctrNo:Edn.fctr^4"            
## [237] "Q109244.fctrYes:Edn.fctr^4"           
## [238] "Q109244.fctrNo:Edn.fctr^5"            
## [239] "Q109244.fctrYes:Edn.fctr^5"           
## [240] "Q109244.fctrNo:Edn.fctr^6"            
## [241] "Q109244.fctrYes:Edn.fctr^6"           
## [242] "Q109244.fctrNo:Edn.fctr^7"            
## [243] "Q109244.fctrYes:Edn.fctr^7"           
## [244] "Q109244.fctrNo:Hhold.fctrMKn"         
## [245] "Q109244.fctrYes:Hhold.fctrMKn"        
## [246] "Q109244.fctrNo:Hhold.fctrMKy"         
## [247] "Q109244.fctrYes:Hhold.fctrMKy"        
## [248] "Q109244.fctrNo:Hhold.fctrPKn"         
## [249] "Q109244.fctrYes:Hhold.fctrPKn"        
## [250] "Q109244.fctrNo:Hhold.fctrPKy"         
## [251] "Q109244.fctrYes:Hhold.fctrPKy"        
## [252] "Q109244.fctrNo:Hhold.fctrSKn"         
## [253] "Q109244.fctrYes:Hhold.fctrSKn"        
## [254] "Q109244.fctrNo:Hhold.fctrSKy"         
## [255] "Q109244.fctrYes:Hhold.fctrSKy"        
## [256] "Q109244.fctrNo:Income.fctr.L"         
## [257] "Q109244.fctrYes:Income.fctr.L"        
## [258] "Q109244.fctrNo:Income.fctr.Q"         
## [259] "Q109244.fctrYes:Income.fctr.Q"        
## [260] "Q109244.fctrNo:Income.fctr.C"         
## [261] "Q109244.fctrYes:Income.fctr.C"        
## [262] "Q109244.fctrNo:Income.fctr^4"         
## [263] "Q109244.fctrYes:Income.fctr^4"        
## [264] "Q109244.fctrNo:Income.fctr^5"         
## [265] "Q109244.fctrYes:Income.fctr^5"        
## [266] "Q109244.fctrNo:Income.fctr^6"         
## [267] "Q109244.fctrYes:Income.fctr^6"        
## [268] "Q109244.fctrNo:Q100689.fctrNo"        
## [269] "Q109244.fctrYes:Q100689.fctrNo"       
## [270] "Q109244.fctrNo:Q100689.fctrYes"       
## [271] "Q109244.fctrYes:Q100689.fctrYes"      
## [272] "Q109244.fctrNo:Q101163.fctrDad"       
## [273] "Q109244.fctrYes:Q101163.fctrDad"      
## [274] "Q109244.fctrNo:Q101163.fctrMom"       
## [275] "Q109244.fctrYes:Q101163.fctrMom"      
## [276] "Q109244.fctrNo:Q102674.fctrNo"        
## [277] "Q109244.fctrYes:Q102674.fctrNo"       
## [278] "Q109244.fctrNo:Q102674.fctrYes"       
## [279] "Q109244.fctrYes:Q102674.fctrYes"      
## [280] "Q109244.fctrNo:Q104996.fctrNo"        
## [281] "Q109244.fctrYes:Q104996.fctrNo"       
## [282] "Q109244.fctrNo:Q104996.fctrYes"       
## [283] "Q109244.fctrYes:Q104996.fctrYes"      
## [284] "Q109244.fctrNo:Q106997.fctrGr"        
## [285] "Q109244.fctrYes:Q106997.fctrGr"       
## [286] "Q109244.fctrNo:Q106997.fctrYy"        
## [287] "Q109244.fctrYes:Q106997.fctrYy"       
## [288] "Q109244.fctrNo:Q108342.fctrIn-person" 
## [289] "Q109244.fctrYes:Q108342.fctrIn-person"
## [290] "Q109244.fctrNo:Q108342.fctrOnline"    
## [291] "Q109244.fctrYes:Q108342.fctrOnline"   
## [292] "Q109244.fctrNo:Q108343.fctrNo"        
## [293] "Q109244.fctrYes:Q108343.fctrNo"       
## [294] "Q109244.fctrNo:Q108343.fctrYes"       
## [295] "Q109244.fctrYes:Q108343.fctrYes"      
## [296] "Q109244.fctrNo:Q113181.fctrNo"        
## [297] "Q109244.fctrYes:Q113181.fctrNo"       
## [298] "Q109244.fctrNo:Q113181.fctrYes"       
## [299] "Q109244.fctrYes:Q113181.fctrYes"      
## [300] "Q109244.fctrNo:Q115611.fctrNo"        
## [301] "Q109244.fctrYes:Q115611.fctrNo"       
## [302] "Q109244.fctrNo:Q115611.fctrYes"       
## [303] "Q109244.fctrYes:Q115611.fctrYes"      
## [304] "Q109244.fctrNo:Q116881.fctrHappy"     
## [305] "Q109244.fctrYes:Q116881.fctrHappy"    
## [306] "Q109244.fctrNo:Q116881.fctrRight"     
## [307] "Q109244.fctrYes:Q116881.fctrRight"    
## [308] "Q109244.fctrNo:Q119334.fctrNo"        
## [309] "Q109244.fctrYes:Q119334.fctrNo"       
## [310] "Q109244.fctrNo:Q119334.fctrYes"       
## [311] "Q109244.fctrYes:Q119334.fctrYes"      
## [312] "Q109244.fctrNo:Q119650.fctrGiving"    
## [313] "Q109244.fctrYes:Q119650.fctrGiving"   
## [314] "Q109244.fctrNo:Q119650.fctrReceiving" 
## [315] "Q109244.fctrYes:Q119650.fctrReceiving"
## [316] "Q109244.fctrNo:Q120379.fctrNo"        
## [317] "Q109244.fctrYes:Q120379.fctrNo"       
## [318] "Q109244.fctrNo:Q120379.fctrYes"       
## [319] "Q109244.fctrYes:Q120379.fctrYes"      
## [320] "Q109244.fctrNo:Q121699.fctrNo"        
## [321] "Q109244.fctrYes:Q121699.fctrNo"       
## [322] "Q109244.fctrNo:Q121699.fctrYes"       
## [323] "Q109244.fctrYes:Q121699.fctrYes"      
## [324] "Q109244.fctrNo:Q122771.fctrPc"        
## [325] "Q109244.fctrYes:Q122771.fctrPc"       
## [326] "Q109244.fctrNo:Q122771.fctrPt"        
## [327] "Q109244.fctrYes:Q122771.fctrPt"       
## [328] "Q109244.fctrNo:Q123621.fctrNo"        
## [329] "Q109244.fctrYes:Q123621.fctrNo"       
## [330] "Q109244.fctrNo:Q123621.fctrYes"       
## [331] "Q109244.fctrYes:Q123621.fctrYes"      
## [332] "Q109244.fctrNo:Q124122.fctrNo"        
## [333] "Q109244.fctrYes:Q124122.fctrNo"       
## [334] "Q109244.fctrNo:Q124122.fctrYes"       
## [335] "Q109244.fctrYes:Q124122.fctrYes"      
## [336] "Q109244.fctrNo:Q98197.fctrNo"         
## [337] "Q109244.fctrYes:Q98197.fctrNo"        
## [338] "Q109244.fctrNo:Q98197.fctrYes"        
## [339] "Q109244.fctrYes:Q98197.fctrYes"       
## [340] "Q109244.fctrNo:YOB.Age.fctr.L"        
## [341] "Q109244.fctrYes:YOB.Age.fctr.L"       
## [342] "Q109244.fctrNo:YOB.Age.fctr.Q"        
## [343] "Q109244.fctrYes:YOB.Age.fctr.Q"       
## [344] "Q109244.fctrNo:YOB.Age.fctr.C"        
## [345] "Q109244.fctrYes:YOB.Age.fctr.C"       
## [346] "Q109244.fctrNo:YOB.Age.fctr^4"        
## [347] "Q109244.fctrYes:YOB.Age.fctr^4"       
## [348] "Q109244.fctrNo:YOB.Age.fctr^5"        
## [349] "Q109244.fctrYes:YOB.Age.fctr^5"       
## [350] "Q109244.fctrNo:YOB.Age.fctr^6"        
## [351] "Q109244.fctrYes:YOB.Age.fctr^6"       
## [352] "Q109244.fctrNo:YOB.Age.fctr^7"        
## [353] "Q109244.fctrYes:YOB.Age.fctr^7"       
## [354] "Q109244.fctrNo:YOB.Age.fctr^8"        
## [355] "Q109244.fctrYes:YOB.Age.fctr^8"       
## [356] "Q109244.fctrNA:.clusterid.fctr2"      
## [357] "Q109244.fctrNo:.clusterid.fctr2"      
## [358] "Q109244.fctrYes:.clusterid.fctr2"     
## [359] "Q109244.fctrNA:.clusterid.fctr3"      
## [360] "Q109244.fctrNo:.clusterid.fctr3"      
## [361] "Q109244.fctrYes:.clusterid.fctr3"     
## [362] "YOB.Age.fctrNA:YOB.Age.dff"           
## [363] "YOB.Age.fctr(15,20]:YOB.Age.dff"      
## [364] "YOB.Age.fctr(20,25]:YOB.Age.dff"      
## [365] "YOB.Age.fctr(25,30]:YOB.Age.dff"      
## [366] "YOB.Age.fctr(30,35]:YOB.Age.dff"      
## [367] "YOB.Age.fctr(35,40]:YOB.Age.dff"      
## [368] "YOB.Age.fctr(40,50]:YOB.Age.dff"      
## [369] "YOB.Age.fctr(50,65]:YOB.Age.dff"      
## [370] "YOB.Age.fctr(65,90]:YOB.Age.dff"      
## [1] "myprint_mdl: problemType:"
## [1] "Classification"
## [1] "myprint_mdl: tuneValue:"
##   degree nprune
## 1      1    256
## [1] "myprint_mdl: obsLevels:"
## [1] "D" "R"
## [1] "myfit_mdl: train diagnostics complete: 1095.374000 secs"

##          Prediction
## Reference    D    R
##         D 2095  856
##         R 1011 1606
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   6.646911e-01   3.246969e-01   6.521172e-01   6.770922e-01   5.299928e-01 
## AccuracyPValue  McnemarPValue 
##   1.733115e-92   3.651218e-04 
## [1] "myfit_mdl: predict complete: 1127.189000 secs"
##                              id
## 1 Final.RFE.X.Inc##rcv#bagEarth
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        feats
## 1 Q121011.fctr,Gender.fctr,Q100010.fctr,Q100562.fctr,Q100680.fctr,Q101162.fctr,Q101596.fctr,Q102089.fctr,Q102289.fctr,Q102687.fctr,Q102906.fctr,Q103293.fctr,Q105655.fctr,Q105840.fctr,Q106042.fctr,Q106272.fctr,Q106388.fctr,Q106389.fctr,Q106993.fctr,Q107491.fctr,Q107869.fctr,Q108617.fctr,Q108754.fctr,Q108855.fctr,Q108856.fctr,Q108950.fctr,Q109367.fctr,Q110740.fctr,Q111220.fctr,Q111580.fctr,Q111848.fctr,Q112270.fctr,Q112478.fctr,Q112512.fctr,Q113583.fctr,Q113584.fctr,Q113992.fctr,Q114152.fctr,Q114386.fctr,Q114517.fctr,Q114748.fctr,Q114961.fctr,Q115195.fctr,Q115390.fctr,Q115602.fctr,Q115610.fctr,Q115777.fctr,Q115899.fctr,Q116197.fctr,Q116441.fctr,Q116448.fctr,Q116601.fctr,Q116797.fctr,Q116953.fctr,Q117186.fctr,Q117193.fctr,Q118117.fctr,Q118232.fctr,Q118233.fctr,Q118237.fctr,Q118892.fctr,Q119851.fctr,Q120012.fctr,Q120014.fctr,Q120194.fctr,Q120472.fctr,Q120650.fctr,Q120978.fctr,Q121700.fctr,Q122120.fctr,Q122769.fctr,Q122770.fctr,Q123464.fctr,Q124742.fctr,Q96024.fctr,Q98078.fctr,Q98578.fctr,Q98869.fctr,Q99480.fctr,Q99581.fctr,Q99716.fctr,Q99982.fctr,Q109244.fctr*Q98197.fctr,Q109244.fctr*Q115611.fctr,Q109244.fctr*Q116881.fctr,Q109244.fctr*Q113181.fctr,Q109244.fctr*Hhold.fctr,Q109244.fctr*Edn.fctr,Q109244.fctr*Q108342.fctr,Q109244.fctr*Q106997.fctr,Q109244.fctr*Q100689.fctr,Q109244.fctr*Q119334.fctr,Q109244.fctr*Q122771.fctr,Q109244.fctr*Q119650.fctr,Q109244.fctr*Q124122.fctr,Q109244.fctr*Income.fctr,Q109244.fctr*Q123621.fctr,Q109244.fctr*Q121699.fctr,Q109244.fctr*Q102674.fctr,Q109244.fctr*Q108343.fctr,Q109244.fctr*Q120379.fctr,Q109244.fctr*Q101163.fctr,Q109244.fctr*Q104996.fctr,Q109244.fctr*YOB.Age.fctr,YOB.Age.fctr:YOB.Age.dff,Q109244.fctr:.clusterid.fctr
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1               0                   1094.474              1092.813
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1       0.6618043    0.7099288    0.6136798       0.7235205
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5        0.632408        0.6646911
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.6521172             0.6770922     0.3246969
## [1] "myfit_mdl: exit: 1127.225000 secs"
## Warning in glb_get_predictions(df = glbObsTrn, mdl_id = thsSpc$id, rsp_var
## = glb_rsp_var, : Using default probability threshold: 0.6
## Warning in glb_get_predictions(df = glbObsNew, mdl_id = thsSpc$id, rsp_var
## = glb_rsp_var, : Using default probability threshold: 0.6
## [1] "myfit_mdl: enter: 0.000000 secs"
## [1] "myfit_mdl: fitting model: Final.All.X#ica#rcv#glmnet"
## [1] "    indepVar: Gender.fctr,Q115611.fctr,Q113181.fctr,Q98197.fctr,Q120472.fctr,Q116881.fctr,Q101596.fctr,Q106272.fctr,Q110740.fctr,Q108855.fctr,Q122771.fctr,Q99480.fctr,Q106388.fctr,Q115899.fctr,Q120014.fctr,Q107869.fctr,Q98869.fctr,Q120650.fctr,Q122769.fctr,Q123621.fctr,Q118117.fctr,Q116441.fctr,Q122120.fctr,Q119334.fctr,Q106993.fctr,Q105655.fctr,Q117186.fctr,Q122770.fctr,Q114152.fctr,Q120194.fctr,Q118232.fctr,Income.fctr,Q116197.fctr,Q102289.fctr,Q118233.fctr,Q108856.fctr,Q99982.fctr,Q117193.fctr,Q123464.fctr,Q111580.fctr,Q119650.fctr,Q118237.fctr,Q112270.fctr,Q116797.fctr,Q124742.fctr,Q99581.fctr,Q115777.fctr,Q101162.fctr,Q98578.fctr,Q108754.fctr,.rnorm,Q106389.fctr,Q96024.fctr,Q108343.fctr,Q112512.fctr,Q120978.fctr,Q106997.fctr,Q115610.fctr,Q116953.fctr,Q115602.fctr,Q100010.fctr,Q108617.fctr,Q100562.fctr,Q107491.fctr,Q114748.fctr,Q112478.fctr,Q103293.fctr,Q102674.fctr,Q108950.fctr,Q113584.fctr,Q102906.fctr,Q104996.fctr,Q116601.fctr,Q116448.fctr,Q106042.fctr,Q121011.fctr,Q113992.fctr,Q111220.fctr,Q124122.fctr,Q121700.fctr,Q114961.fctr,Q109367.fctr,Q120012.fctr,Q114517.fctr,Q119851.fctr,Q115390.fctr,Q102687.fctr,Q118892.fctr,YOB.Age.fctr,Q111848.fctr,Q108342.fctr,Q100680.fctr,Q114386.fctr,Q98059.fctr,Q102089.fctr,Q115195.fctr,Q113583.fctr,Q105840.fctr,Q121699.fctr,Q120379.fctr,Q99716.fctr,Q98078.fctr,Q100689.fctr,Q101163.fctr,Edn.fctr,Hhold.fctr,Q109244.fctr,YOB.Age.fctr:YOB.Age.dff,Q109244.fctr:.clusterid.fctr"
## Warning in myfit_mdl(mdl_specs_lst = thsSpc, indepVar = thsIndepVar,
## rsp_var = glb_rsp_var, : myfit_mdl: preProcess method: range currently does
## not work for columns with no variance: YOB.Age.fctrNA:YOB.Age.dff
## [1] "myfit_mdl: setup complete: 0.888000 secs"
## Warning in preProcess.default(method = "ica", n.comp = 3, x =
## structure(c(-0.480112420809766, : These variables have zero variances:
## YOB.Age.fctrNA:YOB.Age.dff
## + Fold1.Rep1: alpha=0.100, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold1.Rep1: alpha=0.100, lambda=0.02422 
## + Fold1.Rep1: alpha=0.325, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold1.Rep1: alpha=0.325, lambda=0.02422 
## + Fold1.Rep1: alpha=0.550, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold1.Rep1: alpha=0.550, lambda=0.02422 
## + Fold1.Rep1: alpha=0.775, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold1.Rep1: alpha=0.775, lambda=0.02422 
## + Fold1.Rep1: alpha=1.000, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold1.Rep1: alpha=1.000, lambda=0.02422 
## + Fold2.Rep1: alpha=0.100, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold2.Rep1: alpha=0.100, lambda=0.02422 
## + Fold2.Rep1: alpha=0.325, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold2.Rep1: alpha=0.325, lambda=0.02422 
## + Fold2.Rep1: alpha=0.550, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold2.Rep1: alpha=0.550, lambda=0.02422 
## + Fold2.Rep1: alpha=0.775, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold2.Rep1: alpha=0.775, lambda=0.02422 
## + Fold2.Rep1: alpha=1.000, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold2.Rep1: alpha=1.000, lambda=0.02422 
## + Fold3.Rep1: alpha=0.100, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold3.Rep1: alpha=0.100, lambda=0.02422 
## + Fold3.Rep1: alpha=0.325, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold3.Rep1: alpha=0.325, lambda=0.02422 
## + Fold3.Rep1: alpha=0.550, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold3.Rep1: alpha=0.550, lambda=0.02422 
## + Fold3.Rep1: alpha=0.775, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold3.Rep1: alpha=0.775, lambda=0.02422 
## + Fold3.Rep1: alpha=1.000, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold3.Rep1: alpha=1.000, lambda=0.02422 
## + Fold1.Rep2: alpha=0.100, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold1.Rep2: alpha=0.100, lambda=0.02422 
## + Fold1.Rep2: alpha=0.325, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold1.Rep2: alpha=0.325, lambda=0.02422 
## + Fold1.Rep2: alpha=0.550, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold1.Rep2: alpha=0.550, lambda=0.02422 
## + Fold1.Rep2: alpha=0.775, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold1.Rep2: alpha=0.775, lambda=0.02422 
## + Fold1.Rep2: alpha=1.000, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold1.Rep2: alpha=1.000, lambda=0.02422 
## + Fold2.Rep2: alpha=0.100, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold2.Rep2: alpha=0.100, lambda=0.02422 
## + Fold2.Rep2: alpha=0.325, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold2.Rep2: alpha=0.325, lambda=0.02422 
## + Fold2.Rep2: alpha=0.550, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold2.Rep2: alpha=0.550, lambda=0.02422 
## + Fold2.Rep2: alpha=0.775, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold2.Rep2: alpha=0.775, lambda=0.02422 
## + Fold2.Rep2: alpha=1.000, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold2.Rep2: alpha=1.000, lambda=0.02422 
## + Fold3.Rep2: alpha=0.100, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold3.Rep2: alpha=0.100, lambda=0.02422 
## + Fold3.Rep2: alpha=0.325, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold3.Rep2: alpha=0.325, lambda=0.02422 
## + Fold3.Rep2: alpha=0.550, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold3.Rep2: alpha=0.550, lambda=0.02422 
## + Fold3.Rep2: alpha=0.775, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold3.Rep2: alpha=0.775, lambda=0.02422 
## + Fold3.Rep2: alpha=1.000, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold3.Rep2: alpha=1.000, lambda=0.02422 
## + Fold1.Rep3: alpha=0.100, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold1.Rep3: alpha=0.100, lambda=0.02422 
## + Fold1.Rep3: alpha=0.325, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold1.Rep3: alpha=0.325, lambda=0.02422 
## + Fold1.Rep3: alpha=0.550, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold1.Rep3: alpha=0.550, lambda=0.02422 
## + Fold1.Rep3: alpha=0.775, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold1.Rep3: alpha=0.775, lambda=0.02422 
## + Fold1.Rep3: alpha=1.000, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold1.Rep3: alpha=1.000, lambda=0.02422 
## + Fold2.Rep3: alpha=0.100, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold2.Rep3: alpha=0.100, lambda=0.02422 
## + Fold2.Rep3: alpha=0.325, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold2.Rep3: alpha=0.325, lambda=0.02422 
## + Fold2.Rep3: alpha=0.550, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold2.Rep3: alpha=0.550, lambda=0.02422 
## + Fold2.Rep3: alpha=0.775, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold2.Rep3: alpha=0.775, lambda=0.02422 
## + Fold2.Rep3: alpha=1.000, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold2.Rep3: alpha=1.000, lambda=0.02422 
## + Fold3.Rep3: alpha=0.100, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold3.Rep3: alpha=0.100, lambda=0.02422 
## + Fold3.Rep3: alpha=0.325, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold3.Rep3: alpha=0.325, lambda=0.02422 
## + Fold3.Rep3: alpha=0.550, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold3.Rep3: alpha=0.550, lambda=0.02422 
## + Fold3.Rep3: alpha=0.775, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold3.Rep3: alpha=0.775, lambda=0.02422 
## + Fold3.Rep3: alpha=1.000, lambda=0.02422
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff
## - Fold3.Rep3: alpha=1.000, lambda=0.02422 
## Aggregating results
## Selecting tuning parameters
## Fitting alpha = 0.55, lambda = 0.00112 on full training set
## Warning in preProcess.default(thresh = 0.95, k = 5, method = "ica", n.comp
## = 3, : These variables have zero variances: YOB.Age.fctrNA:YOB.Age.dff

## [1] "myfit_mdl: train complete: 53.886000 secs"
## Warning in myfit_mdl(mdl_specs_lst = thsSpc, indepVar = thsIndepVar,
## rsp_var = glb_rsp_var, : model's bestTune found at an extreme of tuneGrid
## for parameter: lambda

##             Length Class      Mode     
## a0           36    -none-     numeric  
## beta        108    dgCMatrix  S4       
## df           36    -none-     numeric  
## dim           2    -none-     numeric  
## lambda       36    -none-     numeric  
## dev.ratio    36    -none-     numeric  
## nulldev       1    -none-     numeric  
## npasses       1    -none-     numeric  
## jerr          1    -none-     numeric  
## offset        1    -none-     logical  
## classnames    2    -none-     character
## call          5    -none-     call     
## nobs          1    -none-     numeric  
## lambdaOpt     1    -none-     numeric  
## xNames        3    -none-     character
## problemType   1    -none-     character
## tuneValue     2    data.frame list     
## obsLevels     2    -none-     character
## [1] "min lambda > lambdaOpt:"
##  (Intercept)         ICA1         ICA2         ICA3 
## -0.121638267 -0.060579277  0.002507085  0.218627380 
## [1] "max lambda < lambdaOpt:"
## [1] "Feats mismatch between coefs_left & rght:"
## [1] "(Intercept)" "ICA1"        "ICA2"        "ICA3"       
## [1] "myfit_mdl: train diagnostics complete: 54.589000 secs"

##          Prediction
## Reference    D    R
##         D 2285  666
##         R 1811  806
##       Accuracy          Kappa  AccuracyLower  AccuracyUpper   AccuracyNull 
##   5.551365e-01   8.438951e-02   5.419676e-01   5.682476e-01   5.299928e-01 
## AccuracyPValue  McnemarPValue 
##   8.842406e-05  6.438284e-117 
## [1] "myfit_mdl: predict complete: 66.233000 secs"
##                           id
## 1 Final.All.X#ica#rcv#glmnet
##                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          feats
## 1 Gender.fctr,Q115611.fctr,Q113181.fctr,Q98197.fctr,Q120472.fctr,Q116881.fctr,Q101596.fctr,Q106272.fctr,Q110740.fctr,Q108855.fctr,Q122771.fctr,Q99480.fctr,Q106388.fctr,Q115899.fctr,Q120014.fctr,Q107869.fctr,Q98869.fctr,Q120650.fctr,Q122769.fctr,Q123621.fctr,Q118117.fctr,Q116441.fctr,Q122120.fctr,Q119334.fctr,Q106993.fctr,Q105655.fctr,Q117186.fctr,Q122770.fctr,Q114152.fctr,Q120194.fctr,Q118232.fctr,Income.fctr,Q116197.fctr,Q102289.fctr,Q118233.fctr,Q108856.fctr,Q99982.fctr,Q117193.fctr,Q123464.fctr,Q111580.fctr,Q119650.fctr,Q118237.fctr,Q112270.fctr,Q116797.fctr,Q124742.fctr,Q99581.fctr,Q115777.fctr,Q101162.fctr,Q98578.fctr,Q108754.fctr,.rnorm,Q106389.fctr,Q96024.fctr,Q108343.fctr,Q112512.fctr,Q120978.fctr,Q106997.fctr,Q115610.fctr,Q116953.fctr,Q115602.fctr,Q100010.fctr,Q108617.fctr,Q100562.fctr,Q107491.fctr,Q114748.fctr,Q112478.fctr,Q103293.fctr,Q102674.fctr,Q108950.fctr,Q113584.fctr,Q102906.fctr,Q104996.fctr,Q116601.fctr,Q116448.fctr,Q106042.fctr,Q121011.fctr,Q113992.fctr,Q111220.fctr,Q124122.fctr,Q121700.fctr,Q114961.fctr,Q109367.fctr,Q120012.fctr,Q114517.fctr,Q119851.fctr,Q115390.fctr,Q102687.fctr,Q118892.fctr,YOB.Age.fctr,Q111848.fctr,Q108342.fctr,Q100680.fctr,Q114386.fctr,Q98059.fctr,Q102089.fctr,Q115195.fctr,Q113583.fctr,Q105840.fctr,Q121699.fctr,Q120379.fctr,Q99716.fctr,Q98078.fctr,Q100689.fctr,Q101163.fctr,Edn.fctr,Hhold.fctr,Q109244.fctr,YOB.Age.fctr:YOB.Age.dff,Q109244.fctr:.clusterid.fctr
##   max.nTuningRuns min.elapsedtime.everything min.elapsedtime.final
## 1              15                     52.873                 1.132
##   max.AUCpROC.fit max.Sens.fit max.Spec.fit max.AUCROCR.fit
## 1         0.54115    0.7743138    0.3079862       0.5668033
##   opt.prob.threshold.fit max.f.score.fit max.Accuracy.fit
## 1                    0.5       0.3942284        0.5525619
##   max.AccuracyLower.fit max.AccuracyUpper.fit max.Kappa.fit
## 1             0.5419676             0.5682476    0.07852091
##   max.AccuracySD.fit max.KappaSD.fit
## 1        0.009734575      0.01708999
## [1] "myfit_mdl: exit: 66.272000 secs"
## Warning in glb_get_predictions(df = glbObsTrn, mdl_id = thsSpc$id, rsp_var
## = glb_rsp_var, : Using default probability threshold: 0.55
## Warning in glb_get_predictions(df = glbObsNew, mdl_id = thsSpc$id, rsp_var
## = glb_rsp_var, : Using default probability threshold: 0.55

rm(ret_lst)
glb_chunks_df <- myadd_chunk(glb_chunks_df, "fit.data.training", major.inc=FALSE)
##               label step_major step_minor label_minor      bgn      end
## 3 fit.data.training          2          0           0  455.508 1668.861
## 4 fit.data.training          2          1           1 1668.862       NA
##    elapsed
## 3 1213.353
## 4       NA
#stop(here"); glb2Sav()
if (glb_is_classification && glb_is_binomial) 
    prob_threshold <- glb_models_df[glb_models_df$id == glbMdlSelId,
                                        "opt.prob.threshold.OOB"] else 
    prob_threshold <- NULL

if (grepl("Ensemble", glbMdlFinId)) {
    # Get predictions for each model in ensemble; Outliers that have been moved to OOB might not have been predicted yet
    mdlEnsembleComps <- unlist(str_split(subset(glb_models_df, 
                                                id == glbMdlFinId)$feats, ","))
    if (glb_is_classification)
    #     mdlEnsembleComps <- gsub("\\.prob$", "", mdlEnsembleComps)
    # mdlEnsembleComps <- gsub(paste0("^", 
    #                     gsub(".", "\\.", mygetPredictIds(glb_rsp_var)$value, fixed = TRUE)),
    #                          "", mdlEnsembleComps)
        mdlEnsembleComps <- glb_models_df$id[sapply(glb_models_df$id, function(thsMdlId)
                        mygetPredictIds(glb_rsp_var, thsMdlId)$prob  %in% mdlEnsembleComps)] else
        mdlEnsembleComps <- glb_models_df$id[sapply(glb_models_df$id, function(thsMdlId)
                        mygetPredictIds(glb_rsp_var, thsMdlId)$value  %in% mdlEnsembleComps)]
                        
    for (mdl_id in mdlEnsembleComps) {
        glbObsTrn <- glb_get_predictions(df = glbObsTrn, mdl_id = mdl_id, 
                                            rsp_var = glb_rsp_var,
                                            prob_threshold_def = prob_threshold)
        glbObsNew <- glb_get_predictions(df = glbObsNew, mdl_id = mdl_id, 
                                            rsp_var = glb_rsp_var,
                                            prob_threshold_def = prob_threshold)
        # glb_fin_mdl uses the same coefficients as glb_sel_mdl, 
        #   so copy the "Final" columns into "non-Final" columns
        glbObsTrn[, gsub("Final.", "", unlist(mygetPredictIds(glb_rsp_var, mdl_id)))] <-
            glbObsTrn[, unlist(mygetPredictIds(glb_rsp_var, mdl_id))]
        glbObsNew[, gsub("Final.", "", unlist(mygetPredictIds(glb_rsp_var, mdl_id)))] <-
            glbObsNew[, unlist(mygetPredictIds(glb_rsp_var, mdl_id))]
    }    
}
## Warning in glb_get_predictions(df = glbObsTrn, mdl_id = mdl_id, rsp_var =
## glb_rsp_var, : Using default probability threshold: 0.65
## Warning in glb_get_predictions(df = glbObsNew, mdl_id = mdl_id, rsp_var =
## glb_rsp_var, : Using default probability threshold: 0.65
## Warning in glb_get_predictions(df = glbObsTrn, mdl_id = mdl_id, rsp_var =
## glb_rsp_var, : Using default probability threshold: 0.65
## Warning in glb_get_predictions(df = glbObsNew, mdl_id = mdl_id, rsp_var =
## glb_rsp_var, : Using default probability threshold: 0.65
glbObsTrn <- glb_get_predictions(df = glbObsTrn, mdl_id = glbMdlFinId, 
                                     rsp_var = glb_rsp_var,
                                    prob_threshold_def = prob_threshold)

glb_featsimp_df <- myget_feats_importance(mdl=glb_fin_mdl,
                                          featsimp_df=glb_featsimp_df)
#glb_featsimp_df[, paste0(glbMdlFinId, ".imp")] <- glb_featsimp_df$imp
print(glb_featsimp_df)
##                                         Ensemble.auto.2..rcv.glmnet.imp
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                      100.000000
## Party.fctr.All.X.ica.rcv.glmnet.prob                           9.724945
## .rnorm                                                         0.000000
##                                                imp
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob 100.000000
## Party.fctr.All.X.ica.rcv.glmnet.prob      9.724945
## .rnorm                                    0.000000
if (glb_is_classification && glb_is_binomial)
    glb_analytics_diag_plots(obs_df=glbObsTrn, mdl_id=glbMdlFinId, 
            prob_threshold=glb_models_df[glb_models_df$id == glbMdlSelId, 
                                         "opt.prob.threshold.OOB"]) else
    glb_analytics_diag_plots(obs_df=glbObsTrn, mdl_id=glbMdlFinId)                  

## [1] "Min/Max Boundaries: "
##   USER_ID Party.fctr Party.fctr.RFE.X.Inc..rcv.bagEarth
## 1    2492          R                                  D
## 2    1798          D                                  D
##   Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## 1                               0.5354627
## 2                               0.1447204
##   Party.fctr.RFE.X.Inc..rcv.bagEarth.is.acc
## 1                                     FALSE
## 2                                      TRUE
##   Party.fctr.RFE.X.Inc..rcv.bagEarth.err
## 1                                   TRUE
## 2                                  FALSE
##   Party.fctr.RFE.X.Inc..rcv.bagEarth.err.abs
## 1                                  0.4645373
## 2                                  0.1447204
##   Party.fctr.RFE.X..rcv.bagEarth Party.fctr.RFE.X..rcv.bagEarth.prob
## 1                              D                           0.4868843
## 2                              D                           0.1119821
##   Party.fctr.RFE.X..rcv.bagEarth.is.acc Party.fctr.RFE.X..rcv.bagEarth.err
## 1                                 FALSE                               TRUE
## 2                                  TRUE                              FALSE
##   Party.fctr.RFE.X..rcv.bagEarth.err.abs
## 1                              0.5131157
## 2                              0.1119821
##   Party.fctr.RFE.X.zv.pca.rcv.glmnet
## 1                                  D
## 2                                  D
##   Party.fctr.RFE.X.zv.pca.rcv.glmnet.prob
## 1                               0.4915753
## 2                               0.1693797
##   Party.fctr.RFE.X.zv.pca.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                      TRUE
##   Party.fctr.RFE.X.zv.pca.rcv.glmnet.err
## 1                                   TRUE
## 2                                  FALSE
##   Party.fctr.RFE.X.zv.pca.rcv.glmnet.err.abs
## 1                                  0.5084247
## 2                                  0.1693797
##   Party.fctr.All.X.nzv.spatialSign.rcv.glmnet
## 1                                           D
## 2                                           D
##   Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## 1                                        0.5198149
## 2                                        0.1564315
##   Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.is.acc
## 1                                              FALSE
## 2                                               TRUE
##   Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.err
## 1                                            TRUE
## 2                                           FALSE
##   Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.err.abs
## 1                                           0.4801851
## 2                                           0.1564315
##   Party.fctr.All.X.spatialSign.rcv.glmnet
## 1                                       D
## 2                                       D
##   Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## 1                                    0.5910747
## 2                                    0.1381459
##   Party.fctr.All.X.spatialSign.rcv.glmnet.is.acc
## 1                                          FALSE
## 2                                           TRUE
##   Party.fctr.All.X.spatialSign.rcv.glmnet.err
## 1                                        TRUE
## 2                                       FALSE
##   Party.fctr.All.X.spatialSign.rcv.glmnet.err.abs
## 1                                       0.4089253
## 2                                       0.1381459
##   Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet
## 1                                           D
## 2                                           D
##   Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.prob
## 1                                        0.5218172
## 2                                        0.1413687
##   Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.is.acc
## 1                                              FALSE
## 2                                               TRUE
##   Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.err
## 1                                            TRUE
## 2                                           FALSE
##   Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.err.abs
## 1                                           0.4781828
## 2                                           0.1413687
##   Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet
## 1                                               D
## 2                                               D
##   Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.prob
## 1                                            0.5447020
## 2                                            0.1168695
##   Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.is.acc
## 1                                                  FALSE
## 2                                                   TRUE
##   Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.err
## 1                                                TRUE
## 2                                               FALSE
##   Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.err.abs
## 1                                               0.4552980
## 2                                               0.1168695
##   Party.fctr.RFE.X.spatialSign.rcv.glmnet
## 1                                       D
## 2                                       D
##   Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## 1                                    0.5927802
## 2                                    0.1290844
##   Party.fctr.RFE.X.spatialSign.rcv.glmnet.is.acc
## 1                                          FALSE
## 2                                           TRUE
##   Party.fctr.RFE.X.spatialSign.rcv.glmnet.err
## 1                                        TRUE
## 2                                       FALSE
##   Party.fctr.RFE.X.spatialSign.rcv.glmnet.err.abs
## 1                                       0.4072198
## 2                                       0.1290844
##   Party.fctr.All.X.nzv.rcv.glmnet Party.fctr.All.X.nzv.rcv.glmnet.prob
## 1                               D                            0.5324093
## 2                               D                            0.1441652
##   Party.fctr.All.X.nzv.rcv.glmnet.is.acc
## 1                                  FALSE
## 2                                   TRUE
##   Party.fctr.All.X.nzv.rcv.glmnet.err
## 1                                TRUE
## 2                               FALSE
##   Party.fctr.All.X.nzv.rcv.glmnet.err.abs Party.fctr.RFE.X.nzv.rcv.glmnet
## 1                               0.4675907                               D
## 2                               0.1441652                               D
##   Party.fctr.RFE.X.nzv.rcv.glmnet.prob
## 1                            0.5334438
## 2                            0.1395257
##   Party.fctr.RFE.X.nzv.rcv.glmnet.is.acc
## 1                                  FALSE
## 2                                   TRUE
##   Party.fctr.RFE.X.nzv.rcv.glmnet.err
## 1                                TRUE
## 2                               FALSE
##   Party.fctr.RFE.X.nzv.rcv.glmnet.err.abs
## 1                               0.4665562
## 2                               0.1395257
##   Party.fctr.All.X.expoTrans.rcv.glmnet
## 1                                     R
## 2                                     D
##   Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## 1                                  0.5842026
## 2                                  0.1297518
##   Party.fctr.All.X.expoTrans.rcv.glmnet.is.acc
## 1                                         TRUE
## 2                                         TRUE
##   Party.fctr.All.X.expoTrans.rcv.glmnet.err
## 1                                     FALSE
## 2                                     FALSE
##   Party.fctr.All.X.expoTrans.rcv.glmnet.err.abs
## 1                                     0.4157974
## 2                                     0.1297518
##   Party.fctr.RFE.X.expoTrans.rcv.glmnet
## 1                                     R
## 2                                     D
##   Party.fctr.RFE.X.expoTrans.rcv.glmnet.prob
## 1                                  0.5842026
## 2                                  0.1297518
##   Party.fctr.RFE.X.expoTrans.rcv.glmnet.is.acc
## 1                                         TRUE
## 2                                         TRUE
##   Party.fctr.RFE.X.expoTrans.rcv.glmnet.err
## 1                                     FALSE
## 2                                     FALSE
##   Party.fctr.RFE.X.expoTrans.rcv.glmnet.err.abs
## 1                                     0.4157974
## 2                                     0.1297518
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet
## 1                                      D
## 2                                      D
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## 1                                   0.5292076
## 2                                   0.1298060
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.is.acc
## 1                                         FALSE
## 2                                          TRUE
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.err
## 1                                       TRUE
## 2                                      FALSE
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.err.abs
## 1                                      0.4707924
## 2                                      0.1298060
##   Party.fctr.RFE.X.YeoJohnson.rcv.glmnet
## 1                                      D
## 2                                      D
##   Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## 1                                   0.5292076
## 2                                   0.1298060
##   Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.is.acc
## 1                                         FALSE
## 2                                          TRUE
##   Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.err
## 1                                       TRUE
## 2                                      FALSE
##   Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.err.abs
## 1                                      0.4707924
## 2                                      0.1298060
##   Party.fctr.RFE.X..rcv.rpart Party.fctr.RFE.X..rcv.rpart.prob
## 1                           R                        0.6666667
## 2                           D                        0.1327078
##   Party.fctr.RFE.X..rcv.rpart.is.acc Party.fctr.RFE.X..rcv.rpart.err
## 1                               TRUE                           FALSE
## 2                               TRUE                           FALSE
##   Party.fctr.RFE.X..rcv.rpart.err.abs Party.fctr.RFE.X..rcv.glmnet
## 1                           0.3333333                            R
## 2                           0.1327078                            D
##   Party.fctr.RFE.X..rcv.glmnet.prob Party.fctr.RFE.X..rcv.glmnet.is.acc
## 1                         0.6034133                                TRUE
## 2                         0.1292298                                TRUE
##   Party.fctr.RFE.X..rcv.glmnet.err Party.fctr.RFE.X..rcv.glmnet.err.abs
## 1                            FALSE                            0.3965867
## 2                            FALSE                            0.1292298
##   Party.fctr.All.X.conditionalX.rcv.glmnet
## 1                                        R
## 2                                        D
##   Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## 1                                     0.6034133
## 2                                     0.1292298
##   Party.fctr.All.X.conditionalX.rcv.glmnet.is.acc
## 1                                            TRUE
## 2                                            TRUE
##   Party.fctr.All.X.conditionalX.rcv.glmnet.err
## 1                                        FALSE
## 2                                        FALSE
##   Party.fctr.All.X.conditionalX.rcv.glmnet.err.abs
## 1                                        0.3965867
## 2                                        0.1292298
##   Party.fctr.All.X..rcv.glmnet Party.fctr.All.X..rcv.glmnet.prob
## 1                            R                         0.6034133
## 2                            D                         0.1292298
##   Party.fctr.All.X..rcv.glmnet.is.acc Party.fctr.All.X..rcv.glmnet.err
## 1                                TRUE                            FALSE
## 2                                TRUE                            FALSE
##   Party.fctr.All.X..rcv.glmnet.err.abs Party.fctr.Low.cor.X..rcv.glmnet
## 1                            0.3965867                                R
## 2                            0.1292298                                D
##   Party.fctr.Low.cor.X..rcv.glmnet.prob
## 1                             0.6034133
## 2                             0.1292298
##   Party.fctr.Low.cor.X..rcv.glmnet.is.acc
## 1                                    TRUE
## 2                                    TRUE
##   Party.fctr.Low.cor.X..rcv.glmnet.err
## 1                                FALSE
## 2                                FALSE
##   Party.fctr.Low.cor.X..rcv.glmnet.err.abs
## 1                                0.3965867
## 2                                0.1292298
##   Party.fctr.RFE.X.conditionalX.rcv.glmnet
## 1                                        R
## 2                                        D
##   Party.fctr.RFE.X.conditionalX.rcv.glmnet.prob
## 1                                     0.6034133
## 2                                     0.1292298
##   Party.fctr.RFE.X.conditionalX.rcv.glmnet.is.acc
## 1                                            TRUE
## 2                                            TRUE
##   Party.fctr.RFE.X.conditionalX.rcv.glmnet.err
## 1                                        FALSE
## 2                                        FALSE
##   Party.fctr.RFE.X.conditionalX.rcv.glmnet.err.abs
## 1                                        0.3965867
## 2                                        0.1292298
##   Party.fctr.All.X.zv.rcv.glmnet Party.fctr.All.X.zv.rcv.glmnet.prob
## 1                              R                           0.6034133
## 2                              D                           0.1292298
##   Party.fctr.All.X.zv.rcv.glmnet.is.acc Party.fctr.All.X.zv.rcv.glmnet.err
## 1                                  TRUE                              FALSE
## 2                                  TRUE                              FALSE
##   Party.fctr.All.X.zv.rcv.glmnet.err.abs Party.fctr.RFE.X.zv.rcv.glmnet
## 1                              0.3965867                              R
## 2                              0.1292298                              D
##   Party.fctr.RFE.X.zv.rcv.glmnet.prob
## 1                           0.6034133
## 2                           0.1292298
##   Party.fctr.RFE.X.zv.rcv.glmnet.is.acc Party.fctr.RFE.X.zv.rcv.glmnet.err
## 1                                  TRUE                              FALSE
## 2                                  TRUE                              FALSE
##   Party.fctr.RFE.X.zv.rcv.glmnet.err.abs Party.fctr.RFE.X.scale.rcv.glmnet
## 1                              0.3965867                                 R
## 2                              0.1292298                                 D
##   Party.fctr.RFE.X.scale.rcv.glmnet.prob
## 1                              0.6034133
## 2                              0.1292298
##   Party.fctr.RFE.X.scale.rcv.glmnet.is.acc
## 1                                     TRUE
## 2                                     TRUE
##   Party.fctr.RFE.X.scale.rcv.glmnet.err
## 1                                 FALSE
## 2                                 FALSE
##   Party.fctr.RFE.X.scale.rcv.glmnet.err.abs
## 1                                 0.3965867
## 2                                 0.1292298
##   Party.fctr.RFE.X.center.rcv.glmnet
## 1                                  R
## 2                                  D
##   Party.fctr.RFE.X.center.rcv.glmnet.prob
## 1                               0.6034133
## 2                               0.1292298
##   Party.fctr.RFE.X.center.rcv.glmnet.is.acc
## 1                                      TRUE
## 2                                      TRUE
##   Party.fctr.RFE.X.center.rcv.glmnet.err
## 1                                  FALSE
## 2                                  FALSE
##   Party.fctr.RFE.X.center.rcv.glmnet.err.abs
## 1                                  0.3965867
## 2                                  0.1292298
##   Party.fctr.All.X.scale.rcv.glmnet Party.fctr.All.X.scale.rcv.glmnet.prob
## 1                                 R                              0.6034133
## 2                                 D                              0.1292298
##   Party.fctr.All.X.scale.rcv.glmnet.is.acc
## 1                                     TRUE
## 2                                     TRUE
##   Party.fctr.All.X.scale.rcv.glmnet.err
## 1                                 FALSE
## 2                                 FALSE
##   Party.fctr.All.X.scale.rcv.glmnet.err.abs
## 1                                 0.3965867
## 2                                 0.1292298
##   Party.fctr.All.X.center.rcv.glmnet
## 1                                  R
## 2                                  D
##   Party.fctr.All.X.center.rcv.glmnet.prob
## 1                               0.6034133
## 2                               0.1292298
##   Party.fctr.All.X.center.rcv.glmnet.is.acc
## 1                                      TRUE
## 2                                      TRUE
##   Party.fctr.All.X.center.rcv.glmnet.err
## 1                                  FALSE
## 2                                  FALSE
##   Party.fctr.All.X.center.rcv.glmnet.err.abs
## 1                                  0.3965867
## 2                                  0.1292298
##   Party.fctr.RFE.X.range.rcv.glmnet Party.fctr.RFE.X.range.rcv.glmnet.prob
## 1                                 R                              0.6034133
## 2                                 D                              0.1292298
##   Party.fctr.RFE.X.range.rcv.glmnet.is.acc
## 1                                     TRUE
## 2                                     TRUE
##   Party.fctr.RFE.X.range.rcv.glmnet.err
## 1                                 FALSE
## 2                                 FALSE
##   Party.fctr.RFE.X.range.rcv.glmnet.err.abs
## 1                                 0.3965867
## 2                                 0.1292298
##   Party.fctr.RFE.X.BoxCox.rcv.glmnet
## 1                                  R
## 2                                  D
##   Party.fctr.RFE.X.BoxCox.rcv.glmnet.prob
## 1                               0.6034133
## 2                               0.1292298
##   Party.fctr.RFE.X.BoxCox.rcv.glmnet.is.acc
## 1                                      TRUE
## 2                                      TRUE
##   Party.fctr.RFE.X.BoxCox.rcv.glmnet.err
## 1                                  FALSE
## 2                                  FALSE
##   Party.fctr.RFE.X.BoxCox.rcv.glmnet.err.abs
## 1                                  0.3965867
## 2                                  0.1292298
##   Party.fctr.All.X.range.rcv.glmnet Party.fctr.All.X.range.rcv.glmnet.prob
## 1                                 R                              0.6034133
## 2                                 D                              0.1292298
##   Party.fctr.All.X.range.rcv.glmnet.is.acc
## 1                                     TRUE
## 2                                     TRUE
##   Party.fctr.All.X.range.rcv.glmnet.err
## 1                                 FALSE
## 2                                 FALSE
##   Party.fctr.All.X.range.rcv.glmnet.err.abs
## 1                                 0.3965867
## 2                                 0.1292298
##   Party.fctr.All.X.BoxCox.rcv.glmnet
## 1                                  R
## 2                                  D
##   Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## 1                               0.6034133
## 2                               0.1292298
##   Party.fctr.All.X.BoxCox.rcv.glmnet.is.acc
## 1                                      TRUE
## 2                                      TRUE
##   Party.fctr.All.X.BoxCox.rcv.glmnet.err
## 1                                  FALSE
## 2                                  FALSE
##   Party.fctr.All.X.BoxCox.rcv.glmnet.err.abs
## 1                                  0.3965867
## 2                                  0.1292298
##   Party.fctr.RFE.X.center.scale.rcv.glmnet
## 1                                        R
## 2                                        D
##   Party.fctr.RFE.X.center.scale.rcv.glmnet.prob
## 1                                     0.6034133
## 2                                     0.1292298
##   Party.fctr.RFE.X.center.scale.rcv.glmnet.is.acc
## 1                                            TRUE
## 2                                            TRUE
##   Party.fctr.RFE.X.center.scale.rcv.glmnet.err
## 1                                        FALSE
## 2                                        FALSE
##   Party.fctr.RFE.X.center.scale.rcv.glmnet.err.abs
## 1                                        0.3965867
## 2                                        0.1292298
##   Party.fctr.All.X.center.scale.rcv.glmnet
## 1                                        R
## 2                                        D
##   Party.fctr.All.X.center.scale.rcv.glmnet.prob
## 1                                     0.6034133
## 2                                     0.1292298
##   Party.fctr.All.X.center.scale.rcv.glmnet.is.acc
## 1                                            TRUE
## 2                                            TRUE
##   Party.fctr.All.X.center.scale.rcv.glmnet.err
## 1                                        FALSE
## 2                                        FALSE
##   Party.fctr.All.X.center.scale.rcv.glmnet.err.abs
## 1                                        0.3965867
## 2                                        0.1292298
##   Party.fctr.All.X.zv.pca.rcv.glmnet
## 1                                  D
## 2                                  D
##   Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## 1                               0.4607583
## 2                               0.2024206
##   Party.fctr.All.X.zv.pca.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                      TRUE
##   Party.fctr.All.X.zv.pca.rcv.glmnet.err
## 1                                   TRUE
## 2                                  FALSE
##   Party.fctr.All.X.zv.pca.rcv.glmnet.err.abs Party.fctr.RFE.X..rcv.gbm
## 1                                  0.5392417                         D
## 2                                  0.2024206                         D
##   Party.fctr.RFE.X..rcv.gbm.prob Party.fctr.RFE.X..rcv.gbm.is.acc
## 1                      0.5763494                            FALSE
## 2                      0.1257216                             TRUE
##   Party.fctr.RFE.X..rcv.gbm.err Party.fctr.RFE.X..rcv.gbm.err.abs
## 1                          TRUE                         0.4236506
## 2                         FALSE                         0.1257216
##   Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet
## 1                                               R
## 2                                               D
##   Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.prob
## 1                                            0.5922596
## 2                                            0.1782018
##   Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.is.acc
## 1                                                   TRUE
## 2                                                   TRUE
##   Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.err
## 1                                               FALSE
## 2                                               FALSE
##   Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.err.abs
## 1                                               0.4077404
## 2                                               0.1782018
##   Party.fctr.RFE.X..rcv.earth Party.fctr.RFE.X..rcv.earth.prob
## 1                           R                        0.6245383
## 2                           D                        0.1040106
##   Party.fctr.RFE.X..rcv.earth.is.acc Party.fctr.RFE.X..rcv.earth.err
## 1                               TRUE                           FALSE
## 2                               TRUE                           FALSE
##   Party.fctr.RFE.X..rcv.earth.err.abs Party.fctr.RFE.X..rcv.glm
## 1                           0.3754617                         D
## 2                           0.1040106                         D
##   Party.fctr.RFE.X..rcv.glm.prob Party.fctr.RFE.X..rcv.glm.is.acc
## 1                      0.4070197                            FALSE
## 2                      0.1689494                             TRUE
##   Party.fctr.RFE.X..rcv.glm.err Party.fctr.RFE.X..rcv.glm.err.abs
## 1                          TRUE                         0.5929803
## 2                         FALSE                         0.1689494
##   Party.fctr.All.X..rcv.glm Party.fctr.All.X..rcv.glm.prob
## 1                         D                      0.4054202
## 2                         D                      0.1992335
##   Party.fctr.All.X..rcv.glm.is.acc Party.fctr.All.X..rcv.glm.err
## 1                            FALSE                          TRUE
## 2                             TRUE                         FALSE
##   Party.fctr.All.X..rcv.glm.err.abs Party.fctr.RFE.X..rcv.rf
## 1                         0.5945798                        R
## 2                         0.1992335                        D
##   Party.fctr.RFE.X..rcv.rf.prob Party.fctr.RFE.X..rcv.rf.is.acc
## 1                         0.842                            TRUE
## 2                         0.070                            TRUE
##   Party.fctr.RFE.X..rcv.rf.err Party.fctr.RFE.X..rcv.rf.err.abs
## 1                        FALSE                            0.158
## 2                        FALSE                            0.070
##   Party.fctr.RFE.X..rcv.avNNet Party.fctr.RFE.X..rcv.avNNet.prob
## 1                            R                         0.6628249
## 2                            D                         0.0839713
##   Party.fctr.RFE.X..rcv.avNNet.is.acc Party.fctr.RFE.X..rcv.avNNet.err
## 1                                TRUE                            FALSE
## 2                                TRUE                            FALSE
##   Party.fctr.RFE.X..rcv.avNNet.err.abs Party.fctr.RFE.X..rcv.nnet
## 1                            0.3371751                          D
## 2                            0.0839713                          D
##   Party.fctr.RFE.X..rcv.nnet.prob Party.fctr.RFE.X..rcv.nnet.is.acc
## 1                       0.5221793                             FALSE
## 2                       0.1829669                              TRUE
##   Party.fctr.RFE.X..rcv.nnet.err Party.fctr.RFE.X..rcv.nnet.err.abs
## 1                           TRUE                          0.4778207
## 2                          FALSE                          0.1829669
##   Party.fctr.RFE.X.ica.rcv.glmnet Party.fctr.RFE.X.ica.rcv.glmnet.prob
## 1                               R                            0.5526477
## 2                               D                            0.3753304
##   Party.fctr.RFE.X.ica.rcv.glmnet.is.acc
## 1                                   TRUE
## 2                                   TRUE
##   Party.fctr.RFE.X.ica.rcv.glmnet.err
## 1                               FALSE
## 2                               FALSE
##   Party.fctr.RFE.X.ica.rcv.glmnet.err.abs Party.fctr.All.X.ica.rcv.glmnet
## 1                               0.4473523                               D
## 2                               0.3753304                               D
##   Party.fctr.All.X.ica.rcv.glmnet.prob
## 1                            0.5494591
## 2                            0.3806985
##   Party.fctr.All.X.ica.rcv.glmnet.is.acc
## 1                                  FALSE
## 2                                   TRUE
##   Party.fctr.All.X.ica.rcv.glmnet.err
## 1                                TRUE
## 2                               FALSE
##   Party.fctr.All.X.ica.rcv.glmnet.err.abs
## 1                               0.4505409
## 2                               0.3806985
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet
## 1                                          D
## 2                                          D
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## 1                                       0.5892031
## 2                                       0.1572367
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.is.acc
## 1                                             FALSE
## 2                                              TRUE
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.err
## 1                                           TRUE
## 2                                          FALSE
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.err.abs
## 1                                          0.4107969
## 2                                          0.1572367
##   Party.fctr.Ensemble.auto.2..rcv.glmnet.prob
## 1                                   0.4774278
## 2                                   0.1092697
##   Party.fctr.Ensemble.auto.2..rcv.glmnet
## 1                                      D
## 2                                      D
##   Party.fctr.Ensemble.auto.2..rcv.glmnet.err
## 1                                       TRUE
## 2                                      FALSE
##   Party.fctr.Ensemble.auto.2..rcv.glmnet.err.abs
## 1                                      0.5225722
## 2                                      0.1092697
##   Party.fctr.Ensemble.auto.2..rcv.glmnet.is.acc
## 1                                         FALSE
## 2                                          TRUE
##   Party.fctr.Final.RFE.X.Inc..rcv.bagEarth.prob
## 1                                     0.5354627
## 2                                     0.1447204
##   Party.fctr.Final.RFE.X.Inc..rcv.bagEarth
## 1                                        D
## 2                                        D
##   Party.fctr.Final.RFE.X.Inc..rcv.bagEarth.err
## 1                                         TRUE
## 2                                        FALSE
##   Party.fctr.Final.RFE.X.Inc..rcv.bagEarth.err.abs
## 1                                        0.4645373
## 2                                        0.1447204
##   Party.fctr.Final.RFE.X.Inc..rcv.bagEarth.is.acc
## 1                                           FALSE
## 2                                            TRUE
##   Party.fctr.Final.All.X.ica.rcv.glmnet.prob
## 1                                  0.5494591
## 2                                  0.3806985
##   Party.fctr.Final.All.X.ica.rcv.glmnet
## 1                                     D
## 2                                     D
##   Party.fctr.Final.All.X.ica.rcv.glmnet.err
## 1                                      TRUE
## 2                                     FALSE
##   Party.fctr.Final.All.X.ica.rcv.glmnet.err.abs
## 1                                     0.4505409
## 2                                     0.3806985
##   Party.fctr.Final.All.X.ica.rcv.glmnet.is.acc
## 1                                        FALSE
## 2                                         TRUE
##   Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.prob
## 1                                         0.5315432
## 2                                         0.1283252
##   Party.fctr.Final.Ensemble.auto.2..rcv.glmnet
## 1                                            D
## 2                                            D
##   Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.err
## 1                                             TRUE
## 2                                            FALSE
##   Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.err.abs
## 1                                            0.4684568
## 2                                            0.1283252
##   Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.is.acc
## 1                                               FALSE
## 2                                                TRUE
##   Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.accurate
## 1                                                 FALSE
## 2                                                  TRUE
##   Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.error .label
## 1                                         -0.1184568   2492
## 2                                          0.0000000   1798
## [1] "Inaccurate: "
##   USER_ID Party.fctr Party.fctr.RFE.X.Inc..rcv.bagEarth
## 1     626          R                                  D
## 2    1236          R                                  D
## 3     468          R                                  D
## 4    3895          R                                  D
## 5     451          R                                  D
## 6    4715          R                                  D
##   Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## 1                              0.08310805
## 2                              0.08610248
## 3                              0.09317883
## 4                              0.09701839
## 5                              0.10419995
## 6                              0.11198014
##   Party.fctr.RFE.X.Inc..rcv.bagEarth.is.acc
## 1                                     FALSE
## 2                                     FALSE
## 3                                     FALSE
## 4                                     FALSE
## 5                                     FALSE
## 6                                     FALSE
##   Party.fctr.RFE.X.Inc..rcv.bagEarth.err
## 1                                   TRUE
## 2                                   TRUE
## 3                                   TRUE
## 4                                   TRUE
## 5                                   TRUE
## 6                                   TRUE
##   Party.fctr.RFE.X.Inc..rcv.bagEarth.err.abs
## 1                                  0.9168919
## 2                                  0.9138975
## 3                                  0.9068212
## 4                                  0.9029816
## 5                                  0.8958000
## 6                                  0.8880199
##   Party.fctr.RFE.X..rcv.bagEarth Party.fctr.RFE.X..rcv.bagEarth.prob
## 1                              D                          0.05429805
## 2                              D                          0.03756575
## 3                              D                          0.04243228
## 4                              D                          0.03131226
## 5                              D                          0.05752716
## 6                              D                          0.08312278
##   Party.fctr.RFE.X..rcv.bagEarth.is.acc Party.fctr.RFE.X..rcv.bagEarth.err
## 1                                 FALSE                               TRUE
## 2                                 FALSE                               TRUE
## 3                                 FALSE                               TRUE
## 4                                 FALSE                               TRUE
## 5                                 FALSE                               TRUE
## 6                                 FALSE                               TRUE
##   Party.fctr.RFE.X..rcv.bagEarth.err.abs
## 1                              0.9457019
## 2                              0.9624342
## 3                              0.9575677
## 4                              0.9686877
## 5                              0.9424728
## 6                              0.9168772
##   Party.fctr.RFE.X.zv.pca.rcv.glmnet
## 1                                  D
## 2                                  D
## 3                                  D
## 4                                  D
## 5                                  D
## 6                                  D
##   Party.fctr.RFE.X.zv.pca.rcv.glmnet.prob
## 1                              0.07256962
## 2                              0.14415487
## 3                              0.07477716
## 4                              0.06556290
## 5                              0.13048428
## 6                              0.17301073
##   Party.fctr.RFE.X.zv.pca.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                     FALSE
## 3                                     FALSE
## 4                                     FALSE
## 5                                     FALSE
## 6                                     FALSE
##   Party.fctr.RFE.X.zv.pca.rcv.glmnet.err
## 1                                   TRUE
## 2                                   TRUE
## 3                                   TRUE
## 4                                   TRUE
## 5                                   TRUE
## 6                                   TRUE
##   Party.fctr.RFE.X.zv.pca.rcv.glmnet.err.abs
## 1                                  0.9274304
## 2                                  0.8558451
## 3                                  0.9252228
## 4                                  0.9344371
## 5                                  0.8695157
## 6                                  0.8269893
##   Party.fctr.All.X.nzv.spatialSign.rcv.glmnet
## 1                                           D
## 2                                           D
## 3                                           D
## 4                                           D
## 5                                           D
## 6                                           D
##   Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## 1                                        0.1084418
## 2                                        0.1222990
## 3                                        0.1102796
## 4                                        0.1172416
## 5                                        0.1161760
## 6                                        0.1510613
##   Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.is.acc
## 1                                              FALSE
## 2                                              FALSE
## 3                                              FALSE
## 4                                              FALSE
## 5                                              FALSE
## 6                                              FALSE
##   Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.err
## 1                                            TRUE
## 2                                            TRUE
## 3                                            TRUE
## 4                                            TRUE
## 5                                            TRUE
## 6                                            TRUE
##   Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.err.abs
## 1                                           0.8915582
## 2                                           0.8777010
## 3                                           0.8897204
## 4                                           0.8827584
## 5                                           0.8838240
## 6                                           0.8489387
##   Party.fctr.All.X.spatialSign.rcv.glmnet
## 1                                       D
## 2                                       D
## 3                                       D
## 4                                       D
## 5                                       D
## 6                                       D
##   Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## 1                                   0.13493569
## 2                                   0.08077740
## 3                                   0.12514092
## 4                                   0.07604966
## 5                                   0.12157711
## 6                                   0.13014204
##   Party.fctr.All.X.spatialSign.rcv.glmnet.is.acc
## 1                                          FALSE
## 2                                          FALSE
## 3                                          FALSE
## 4                                          FALSE
## 5                                          FALSE
## 6                                          FALSE
##   Party.fctr.All.X.spatialSign.rcv.glmnet.err
## 1                                        TRUE
## 2                                        TRUE
## 3                                        TRUE
## 4                                        TRUE
## 5                                        TRUE
## 6                                        TRUE
##   Party.fctr.All.X.spatialSign.rcv.glmnet.err.abs
## 1                                       0.8650643
## 2                                       0.9192226
## 3                                       0.8748591
## 4                                       0.9239503
## 5                                       0.8784229
## 6                                       0.8698580
##   Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet
## 1                                           D
## 2                                           D
## 3                                           D
## 4                                           D
## 5                                           D
## 6                                           D
##   Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.prob
## 1                                        0.1099431
## 2                                        0.1231948
## 3                                        0.1029184
## 4                                        0.1074752
## 5                                        0.1179969
## 6                                        0.1530509
##   Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.is.acc
## 1                                              FALSE
## 2                                              FALSE
## 3                                              FALSE
## 4                                              FALSE
## 5                                              FALSE
## 6                                              FALSE
##   Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.err
## 1                                            TRUE
## 2                                            TRUE
## 3                                            TRUE
## 4                                            TRUE
## 5                                            TRUE
## 6                                            TRUE
##   Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.err.abs
## 1                                           0.8900569
## 2                                           0.8768052
## 3                                           0.8970816
## 4                                           0.8925248
## 5                                           0.8820031
## 6                                           0.8469491
##   Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet
## 1                                               D
## 2                                               D
## 3                                               D
## 4                                               D
## 5                                               D
## 6                                               D
##   Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.prob
## 1                                           0.08839564
## 2                                           0.09376318
## 3                                           0.08595588
## 4                                           0.09115331
## 5                                           0.09500306
## 6                                           0.12567192
##   Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.is.acc
## 1                                                  FALSE
## 2                                                  FALSE
## 3                                                  FALSE
## 4                                                  FALSE
## 5                                                  FALSE
## 6                                                  FALSE
##   Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.err
## 1                                                TRUE
## 2                                                TRUE
## 3                                                TRUE
## 4                                                TRUE
## 5                                                TRUE
## 6                                                TRUE
##   Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.err.abs
## 1                                               0.9116044
## 2                                               0.9062368
## 3                                               0.9140441
## 4                                               0.9088467
## 5                                               0.9049969
## 6                                               0.8743281
##   Party.fctr.RFE.X.spatialSign.rcv.glmnet
## 1                                       D
## 2                                       D
## 3                                       D
## 4                                       D
## 5                                       D
## 6                                       D
##   Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## 1                                   0.13560265
## 2                                   0.08095251
## 3                                   0.12105058
## 4                                   0.07198825
## 5                                   0.12229543
## 6                                   0.13092250
##   Party.fctr.RFE.X.spatialSign.rcv.glmnet.is.acc
## 1                                          FALSE
## 2                                          FALSE
## 3                                          FALSE
## 4                                          FALSE
## 5                                          FALSE
## 6                                          FALSE
##   Party.fctr.RFE.X.spatialSign.rcv.glmnet.err
## 1                                        TRUE
## 2                                        TRUE
## 3                                        TRUE
## 4                                        TRUE
## 5                                        TRUE
## 6                                        TRUE
##   Party.fctr.RFE.X.spatialSign.rcv.glmnet.err.abs
## 1                                       0.8643974
## 2                                       0.9190475
## 3                                       0.8789494
## 4                                       0.9280118
## 5                                       0.8777046
## 6                                       0.8690775
##   Party.fctr.All.X.nzv.rcv.glmnet Party.fctr.All.X.nzv.rcv.glmnet.prob
## 1                               D                           0.09349482
## 2                               D                           0.13278055
## 3                               D                           0.08945309
## 4                               D                           0.11830363
## 5                               D                           0.09804767
## 6                               D                           0.14620520
##   Party.fctr.All.X.nzv.rcv.glmnet.is.acc
## 1                                  FALSE
## 2                                  FALSE
## 3                                  FALSE
## 4                                  FALSE
## 5                                  FALSE
## 6                                  FALSE
##   Party.fctr.All.X.nzv.rcv.glmnet.err
## 1                                TRUE
## 2                                TRUE
## 3                                TRUE
## 4                                TRUE
## 5                                TRUE
## 6                                TRUE
##   Party.fctr.All.X.nzv.rcv.glmnet.err.abs Party.fctr.RFE.X.nzv.rcv.glmnet
## 1                               0.9065052                               D
## 2                               0.8672194                               D
## 3                               0.9105469                               D
## 4                               0.8816964                               D
## 5                               0.9019523                               D
## 6                               0.8537948                               D
##   Party.fctr.RFE.X.nzv.rcv.glmnet.prob
## 1                           0.09413719
## 2                           0.13339084
## 3                           0.08699289
## 4                           0.11503559
## 5                           0.09916363
## 6                           0.14718798
##   Party.fctr.RFE.X.nzv.rcv.glmnet.is.acc
## 1                                  FALSE
## 2                                  FALSE
## 3                                  FALSE
## 4                                  FALSE
## 5                                  FALSE
## 6                                  FALSE
##   Party.fctr.RFE.X.nzv.rcv.glmnet.err
## 1                                TRUE
## 2                                TRUE
## 3                                TRUE
## 4                                TRUE
## 5                                TRUE
## 6                                TRUE
##   Party.fctr.RFE.X.nzv.rcv.glmnet.err.abs
## 1                               0.9058628
## 2                               0.8666092
## 3                               0.9130071
## 4                               0.8849644
## 5                               0.9008364
## 6                               0.8528120
##   Party.fctr.All.X.expoTrans.rcv.glmnet
## 1                                     D
## 2                                     D
## 3                                     D
## 4                                     D
## 5                                     D
## 6                                     D
##   Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## 1                                 0.09914476
## 2                                 0.08352619
## 3                                 0.10791786
## 4                                 0.06917972
## 5                                 0.11191494
## 6                                 0.12854985
##   Party.fctr.All.X.expoTrans.rcv.glmnet.is.acc
## 1                                        FALSE
## 2                                        FALSE
## 3                                        FALSE
## 4                                        FALSE
## 5                                        FALSE
## 6                                        FALSE
##   Party.fctr.All.X.expoTrans.rcv.glmnet.err
## 1                                      TRUE
## 2                                      TRUE
## 3                                      TRUE
## 4                                      TRUE
## 5                                      TRUE
## 6                                      TRUE
##   Party.fctr.All.X.expoTrans.rcv.glmnet.err.abs
## 1                                     0.9008552
## 2                                     0.9164738
## 3                                     0.8920821
## 4                                     0.9308203
## 5                                     0.8880851
## 6                                     0.8714502
##   Party.fctr.RFE.X.expoTrans.rcv.glmnet
## 1                                     D
## 2                                     D
## 3                                     D
## 4                                     D
## 5                                     D
## 6                                     D
##   Party.fctr.RFE.X.expoTrans.rcv.glmnet.prob
## 1                                 0.09914476
## 2                                 0.08352619
## 3                                 0.10791786
## 4                                 0.06917972
## 5                                 0.11191494
## 6                                 0.12854985
##   Party.fctr.RFE.X.expoTrans.rcv.glmnet.is.acc
## 1                                        FALSE
## 2                                        FALSE
## 3                                        FALSE
## 4                                        FALSE
## 5                                        FALSE
## 6                                        FALSE
##   Party.fctr.RFE.X.expoTrans.rcv.glmnet.err
## 1                                      TRUE
## 2                                      TRUE
## 3                                      TRUE
## 4                                      TRUE
## 5                                      TRUE
## 6                                      TRUE
##   Party.fctr.RFE.X.expoTrans.rcv.glmnet.err.abs
## 1                                     0.9008552
## 2                                     0.9164738
## 3                                     0.8920821
## 4                                     0.9308203
## 5                                     0.8880851
## 6                                     0.8714502
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet
## 1                                      D
## 2                                      D
## 3                                      D
## 4                                      D
## 5                                      D
## 6                                      D
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## 1                                  0.09922106
## 2                                  0.08355202
## 3                                  0.10799757
## 4                                  0.06922470
## 5                                  0.11199083
## 6                                  0.12851770
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.is.acc
## 1                                         FALSE
## 2                                         FALSE
## 3                                         FALSE
## 4                                         FALSE
## 5                                         FALSE
## 6                                         FALSE
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.err
## 1                                       TRUE
## 2                                       TRUE
## 3                                       TRUE
## 4                                       TRUE
## 5                                       TRUE
## 6                                       TRUE
##   Party.fctr.All.X.YeoJohnson.rcv.glmnet.err.abs
## 1                                      0.9007789
## 2                                      0.9164480
## 3                                      0.8920024
## 4                                      0.9307753
## 5                                      0.8880092
## 6                                      0.8714823
##   Party.fctr.RFE.X.YeoJohnson.rcv.glmnet
## 1                                      D
## 2                                      D
## 3                                      D
## 4                                      D
## 5                                      D
## 6                                      D
##   Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## 1                                  0.09922106
## 2                                  0.08355202
## 3                                  0.10799757
## 4                                  0.06922470
## 5                                  0.11199083
## 6                                  0.12851770
##   Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.is.acc
## 1                                         FALSE
## 2                                         FALSE
## 3                                         FALSE
## 4                                         FALSE
## 5                                         FALSE
## 6                                         FALSE
##   Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.err
## 1                                       TRUE
## 2                                       TRUE
## 3                                       TRUE
## 4                                       TRUE
## 5                                       TRUE
## 6                                       TRUE
##   Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.err.abs
## 1                                      0.9007789
## 2                                      0.9164480
## 3                                      0.8920024
## 4                                      0.9307753
## 5                                      0.8880092
## 6                                      0.8714823
##   Party.fctr.RFE.X..rcv.rpart Party.fctr.RFE.X..rcv.rpart.prob
## 1                           D                        0.1327078
## 2                           D                        0.1327078
## 3                           D                        0.1327078
## 4                           D                        0.1327078
## 5                           D                        0.1327078
## 6                           D                        0.1327078
##   Party.fctr.RFE.X..rcv.rpart.is.acc Party.fctr.RFE.X..rcv.rpart.err
## 1                              FALSE                            TRUE
## 2                              FALSE                            TRUE
## 3                              FALSE                            TRUE
## 4                              FALSE                            TRUE
## 5                              FALSE                            TRUE
## 6                              FALSE                            TRUE
##   Party.fctr.RFE.X..rcv.rpart.err.abs Party.fctr.RFE.X..rcv.glmnet
## 1                           0.8672922                            D
## 2                           0.8672922                            D
## 3                           0.8672922                            D
## 4                           0.8672922                            D
## 5                           0.8672922                            D
## 6                           0.8672922                            D
##   Party.fctr.RFE.X..rcv.glmnet.prob Party.fctr.RFE.X..rcv.glmnet.is.acc
## 1                        0.09865842                               FALSE
## 2                        0.08397483                               FALSE
## 3                        0.10237246                               FALSE
## 4                        0.06723964                               FALSE
## 5                        0.11159137                               FALSE
## 6                        0.12911017                               FALSE
##   Party.fctr.RFE.X..rcv.glmnet.err Party.fctr.RFE.X..rcv.glmnet.err.abs
## 1                             TRUE                            0.9013416
## 2                             TRUE                            0.9160252
## 3                             TRUE                            0.8976275
## 4                             TRUE                            0.9327604
## 5                             TRUE                            0.8884086
## 6                             TRUE                            0.8708898
##   Party.fctr.All.X.conditionalX.rcv.glmnet
## 1                                        D
## 2                                        D
## 3                                        D
## 4                                        D
## 5                                        D
## 6                                        D
##   Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## 1                                    0.09865842
## 2                                    0.08397483
## 3                                    0.10237246
## 4                                    0.06723964
## 5                                    0.11159137
## 6                                    0.12911017
##   Party.fctr.All.X.conditionalX.rcv.glmnet.is.acc
## 1                                           FALSE
## 2                                           FALSE
## 3                                           FALSE
## 4                                           FALSE
## 5                                           FALSE
## 6                                           FALSE
##   Party.fctr.All.X.conditionalX.rcv.glmnet.err
## 1                                         TRUE
## 2                                         TRUE
## 3                                         TRUE
## 4                                         TRUE
## 5                                         TRUE
## 6                                         TRUE
##   Party.fctr.All.X.conditionalX.rcv.glmnet.err.abs
## 1                                        0.9013416
## 2                                        0.9160252
## 3                                        0.8976275
## 4                                        0.9327604
## 5                                        0.8884086
## 6                                        0.8708898
##   Party.fctr.All.X..rcv.glmnet Party.fctr.All.X..rcv.glmnet.prob
## 1                            D                        0.09865842
## 2                            D                        0.08397483
## 3                            D                        0.10237246
## 4                            D                        0.06723964
## 5                            D                        0.11159137
## 6                            D                        0.12911017
##   Party.fctr.All.X..rcv.glmnet.is.acc Party.fctr.All.X..rcv.glmnet.err
## 1                               FALSE                             TRUE
## 2                               FALSE                             TRUE
## 3                               FALSE                             TRUE
## 4                               FALSE                             TRUE
## 5                               FALSE                             TRUE
## 6                               FALSE                             TRUE
##   Party.fctr.All.X..rcv.glmnet.err.abs Party.fctr.Low.cor.X..rcv.glmnet
## 1                            0.9013416                                D
## 2                            0.9160252                                D
## 3                            0.8976275                                D
## 4                            0.9327604                                D
## 5                            0.8884086                                D
## 6                            0.8708898                                D
##   Party.fctr.Low.cor.X..rcv.glmnet.prob
## 1                            0.09865842
## 2                            0.08397483
## 3                            0.10237246
## 4                            0.06723964
## 5                            0.11159137
## 6                            0.12911017
##   Party.fctr.Low.cor.X..rcv.glmnet.is.acc
## 1                                   FALSE
## 2                                   FALSE
## 3                                   FALSE
## 4                                   FALSE
## 5                                   FALSE
## 6                                   FALSE
##   Party.fctr.Low.cor.X..rcv.glmnet.err
## 1                                 TRUE
## 2                                 TRUE
## 3                                 TRUE
## 4                                 TRUE
## 5                                 TRUE
## 6                                 TRUE
##   Party.fctr.Low.cor.X..rcv.glmnet.err.abs
## 1                                0.9013416
## 2                                0.9160252
## 3                                0.8976275
## 4                                0.9327604
## 5                                0.8884086
## 6                                0.8708898
##   Party.fctr.RFE.X.conditionalX.rcv.glmnet
## 1                                        D
## 2                                        D
## 3                                        D
## 4                                        D
## 5                                        D
## 6                                        D
##   Party.fctr.RFE.X.conditionalX.rcv.glmnet.prob
## 1                                    0.09865842
## 2                                    0.08397483
## 3                                    0.10237246
## 4                                    0.06723964
## 5                                    0.11159137
## 6                                    0.12911017
##   Party.fctr.RFE.X.conditionalX.rcv.glmnet.is.acc
## 1                                           FALSE
## 2                                           FALSE
## 3                                           FALSE
## 4                                           FALSE
## 5                                           FALSE
## 6                                           FALSE
##   Party.fctr.RFE.X.conditionalX.rcv.glmnet.err
## 1                                         TRUE
## 2                                         TRUE
## 3                                         TRUE
## 4                                         TRUE
## 5                                         TRUE
## 6                                         TRUE
##   Party.fctr.RFE.X.conditionalX.rcv.glmnet.err.abs
## 1                                        0.9013416
## 2                                        0.9160252
## 3                                        0.8976275
## 4                                        0.9327604
## 5                                        0.8884086
## 6                                        0.8708898
##   Party.fctr.All.X.zv.rcv.glmnet Party.fctr.All.X.zv.rcv.glmnet.prob
## 1                              D                          0.09865842
## 2                              D                          0.08397483
## 3                              D                          0.10237246
## 4                              D                          0.06723964
## 5                              D                          0.11159137
## 6                              D                          0.12911017
##   Party.fctr.All.X.zv.rcv.glmnet.is.acc Party.fctr.All.X.zv.rcv.glmnet.err
## 1                                 FALSE                               TRUE
## 2                                 FALSE                               TRUE
## 3                                 FALSE                               TRUE
## 4                                 FALSE                               TRUE
## 5                                 FALSE                               TRUE
## 6                                 FALSE                               TRUE
##   Party.fctr.All.X.zv.rcv.glmnet.err.abs Party.fctr.RFE.X.zv.rcv.glmnet
## 1                              0.9013416                              D
## 2                              0.9160252                              D
## 3                              0.8976275                              D
## 4                              0.9327604                              D
## 5                              0.8884086                              D
## 6                              0.8708898                              D
##   Party.fctr.RFE.X.zv.rcv.glmnet.prob
## 1                          0.09865842
## 2                          0.08397483
## 3                          0.10237246
## 4                          0.06723964
## 5                          0.11159137
## 6                          0.12911017
##   Party.fctr.RFE.X.zv.rcv.glmnet.is.acc Party.fctr.RFE.X.zv.rcv.glmnet.err
## 1                                 FALSE                               TRUE
## 2                                 FALSE                               TRUE
## 3                                 FALSE                               TRUE
## 4                                 FALSE                               TRUE
## 5                                 FALSE                               TRUE
## 6                                 FALSE                               TRUE
##   Party.fctr.RFE.X.zv.rcv.glmnet.err.abs Party.fctr.RFE.X.scale.rcv.glmnet
## 1                              0.9013416                                 D
## 2                              0.9160252                                 D
## 3                              0.8976275                                 D
## 4                              0.9327604                                 D
## 5                              0.8884086                                 D
## 6                              0.8708898                                 D
##   Party.fctr.RFE.X.scale.rcv.glmnet.prob
## 1                             0.09865842
## 2                             0.08397483
## 3                             0.10237246
## 4                             0.06723964
## 5                             0.11159137
## 6                             0.12911017
##   Party.fctr.RFE.X.scale.rcv.glmnet.is.acc
## 1                                    FALSE
## 2                                    FALSE
## 3                                    FALSE
## 4                                    FALSE
## 5                                    FALSE
## 6                                    FALSE
##   Party.fctr.RFE.X.scale.rcv.glmnet.err
## 1                                  TRUE
## 2                                  TRUE
## 3                                  TRUE
## 4                                  TRUE
## 5                                  TRUE
## 6                                  TRUE
##   Party.fctr.RFE.X.scale.rcv.glmnet.err.abs
## 1                                 0.9013416
## 2                                 0.9160252
## 3                                 0.8976275
## 4                                 0.9327604
## 5                                 0.8884086
## 6                                 0.8708898
##   Party.fctr.RFE.X.center.rcv.glmnet
## 1                                  D
## 2                                  D
## 3                                  D
## 4                                  D
## 5                                  D
## 6                                  D
##   Party.fctr.RFE.X.center.rcv.glmnet.prob
## 1                              0.09865842
## 2                              0.08397483
## 3                              0.10237246
## 4                              0.06723964
## 5                              0.11159137
## 6                              0.12911017
##   Party.fctr.RFE.X.center.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                     FALSE
## 3                                     FALSE
## 4                                     FALSE
## 5                                     FALSE
## 6                                     FALSE
##   Party.fctr.RFE.X.center.rcv.glmnet.err
## 1                                   TRUE
## 2                                   TRUE
## 3                                   TRUE
## 4                                   TRUE
## 5                                   TRUE
## 6                                   TRUE
##   Party.fctr.RFE.X.center.rcv.glmnet.err.abs
## 1                                  0.9013416
## 2                                  0.9160252
## 3                                  0.8976275
## 4                                  0.9327604
## 5                                  0.8884086
## 6                                  0.8708898
##   Party.fctr.All.X.scale.rcv.glmnet Party.fctr.All.X.scale.rcv.glmnet.prob
## 1                                 D                             0.09865842
## 2                                 D                             0.08397483
## 3                                 D                             0.10237246
## 4                                 D                             0.06723964
## 5                                 D                             0.11159137
## 6                                 D                             0.12911017
##   Party.fctr.All.X.scale.rcv.glmnet.is.acc
## 1                                    FALSE
## 2                                    FALSE
## 3                                    FALSE
## 4                                    FALSE
## 5                                    FALSE
## 6                                    FALSE
##   Party.fctr.All.X.scale.rcv.glmnet.err
## 1                                  TRUE
## 2                                  TRUE
## 3                                  TRUE
## 4                                  TRUE
## 5                                  TRUE
## 6                                  TRUE
##   Party.fctr.All.X.scale.rcv.glmnet.err.abs
## 1                                 0.9013416
## 2                                 0.9160252
## 3                                 0.8976275
## 4                                 0.9327604
## 5                                 0.8884086
## 6                                 0.8708898
##   Party.fctr.All.X.center.rcv.glmnet
## 1                                  D
## 2                                  D
## 3                                  D
## 4                                  D
## 5                                  D
## 6                                  D
##   Party.fctr.All.X.center.rcv.glmnet.prob
## 1                              0.09865842
## 2                              0.08397483
## 3                              0.10237246
## 4                              0.06723964
## 5                              0.11159137
## 6                              0.12911017
##   Party.fctr.All.X.center.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                     FALSE
## 3                                     FALSE
## 4                                     FALSE
## 5                                     FALSE
## 6                                     FALSE
##   Party.fctr.All.X.center.rcv.glmnet.err
## 1                                   TRUE
## 2                                   TRUE
## 3                                   TRUE
## 4                                   TRUE
## 5                                   TRUE
## 6                                   TRUE
##   Party.fctr.All.X.center.rcv.glmnet.err.abs
## 1                                  0.9013416
## 2                                  0.9160252
## 3                                  0.8976275
## 4                                  0.9327604
## 5                                  0.8884086
## 6                                  0.8708898
##   Party.fctr.RFE.X.range.rcv.glmnet Party.fctr.RFE.X.range.rcv.glmnet.prob
## 1                                 D                             0.09865842
## 2                                 D                             0.08397483
## 3                                 D                             0.10237246
## 4                                 D                             0.06723964
## 5                                 D                             0.11159137
## 6                                 D                             0.12911017
##   Party.fctr.RFE.X.range.rcv.glmnet.is.acc
## 1                                    FALSE
## 2                                    FALSE
## 3                                    FALSE
## 4                                    FALSE
## 5                                    FALSE
## 6                                    FALSE
##   Party.fctr.RFE.X.range.rcv.glmnet.err
## 1                                  TRUE
## 2                                  TRUE
## 3                                  TRUE
## 4                                  TRUE
## 5                                  TRUE
## 6                                  TRUE
##   Party.fctr.RFE.X.range.rcv.glmnet.err.abs
## 1                                 0.9013416
## 2                                 0.9160252
## 3                                 0.8976275
## 4                                 0.9327604
## 5                                 0.8884086
## 6                                 0.8708898
##   Party.fctr.RFE.X.BoxCox.rcv.glmnet
## 1                                  D
## 2                                  D
## 3                                  D
## 4                                  D
## 5                                  D
## 6                                  D
##   Party.fctr.RFE.X.BoxCox.rcv.glmnet.prob
## 1                              0.09865842
## 2                              0.08397483
## 3                              0.10237246
## 4                              0.06723964
## 5                              0.11159137
## 6                              0.12911017
##   Party.fctr.RFE.X.BoxCox.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                     FALSE
## 3                                     FALSE
## 4                                     FALSE
## 5                                     FALSE
## 6                                     FALSE
##   Party.fctr.RFE.X.BoxCox.rcv.glmnet.err
## 1                                   TRUE
## 2                                   TRUE
## 3                                   TRUE
## 4                                   TRUE
## 5                                   TRUE
## 6                                   TRUE
##   Party.fctr.RFE.X.BoxCox.rcv.glmnet.err.abs
## 1                                  0.9013416
## 2                                  0.9160252
## 3                                  0.8976275
## 4                                  0.9327604
## 5                                  0.8884086
## 6                                  0.8708898
##   Party.fctr.All.X.range.rcv.glmnet Party.fctr.All.X.range.rcv.glmnet.prob
## 1                                 D                             0.09865842
## 2                                 D                             0.08397483
## 3                                 D                             0.10237246
## 4                                 D                             0.06723964
## 5                                 D                             0.11159137
## 6                                 D                             0.12911017
##   Party.fctr.All.X.range.rcv.glmnet.is.acc
## 1                                    FALSE
## 2                                    FALSE
## 3                                    FALSE
## 4                                    FALSE
## 5                                    FALSE
## 6                                    FALSE
##   Party.fctr.All.X.range.rcv.glmnet.err
## 1                                  TRUE
## 2                                  TRUE
## 3                                  TRUE
## 4                                  TRUE
## 5                                  TRUE
## 6                                  TRUE
##   Party.fctr.All.X.range.rcv.glmnet.err.abs
## 1                                 0.9013416
## 2                                 0.9160252
## 3                                 0.8976275
## 4                                 0.9327604
## 5                                 0.8884086
## 6                                 0.8708898
##   Party.fctr.All.X.BoxCox.rcv.glmnet
## 1                                  D
## 2                                  D
## 3                                  D
## 4                                  D
## 5                                  D
## 6                                  D
##   Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## 1                              0.09865842
## 2                              0.08397483
## 3                              0.10237246
## 4                              0.06723964
## 5                              0.11159137
## 6                              0.12911017
##   Party.fctr.All.X.BoxCox.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                     FALSE
## 3                                     FALSE
## 4                                     FALSE
## 5                                     FALSE
## 6                                     FALSE
##   Party.fctr.All.X.BoxCox.rcv.glmnet.err
## 1                                   TRUE
## 2                                   TRUE
## 3                                   TRUE
## 4                                   TRUE
## 5                                   TRUE
## 6                                   TRUE
##   Party.fctr.All.X.BoxCox.rcv.glmnet.err.abs
## 1                                  0.9013416
## 2                                  0.9160252
## 3                                  0.8976275
## 4                                  0.9327604
## 5                                  0.8884086
## 6                                  0.8708898
##   Party.fctr.RFE.X.center.scale.rcv.glmnet
## 1                                        D
## 2                                        D
## 3                                        D
## 4                                        D
## 5                                        D
## 6                                        D
##   Party.fctr.RFE.X.center.scale.rcv.glmnet.prob
## 1                                    0.09865842
## 2                                    0.08397483
## 3                                    0.10237246
## 4                                    0.06723964
## 5                                    0.11159137
## 6                                    0.12911017
##   Party.fctr.RFE.X.center.scale.rcv.glmnet.is.acc
## 1                                           FALSE
## 2                                           FALSE
## 3                                           FALSE
## 4                                           FALSE
## 5                                           FALSE
## 6                                           FALSE
##   Party.fctr.RFE.X.center.scale.rcv.glmnet.err
## 1                                         TRUE
## 2                                         TRUE
## 3                                         TRUE
## 4                                         TRUE
## 5                                         TRUE
## 6                                         TRUE
##   Party.fctr.RFE.X.center.scale.rcv.glmnet.err.abs
## 1                                        0.9013416
## 2                                        0.9160252
## 3                                        0.8976275
## 4                                        0.9327604
## 5                                        0.8884086
## 6                                        0.8708898
##   Party.fctr.All.X.center.scale.rcv.glmnet
## 1                                        D
## 2                                        D
## 3                                        D
## 4                                        D
## 5                                        D
## 6                                        D
##   Party.fctr.All.X.center.scale.rcv.glmnet.prob
## 1                                    0.09865842
## 2                                    0.08397483
## 3                                    0.10237246
## 4                                    0.06723964
## 5                                    0.11159137
## 6                                    0.12911017
##   Party.fctr.All.X.center.scale.rcv.glmnet.is.acc
## 1                                           FALSE
## 2                                           FALSE
## 3                                           FALSE
## 4                                           FALSE
## 5                                           FALSE
## 6                                           FALSE
##   Party.fctr.All.X.center.scale.rcv.glmnet.err
## 1                                         TRUE
## 2                                         TRUE
## 3                                         TRUE
## 4                                         TRUE
## 5                                         TRUE
## 6                                         TRUE
##   Party.fctr.All.X.center.scale.rcv.glmnet.err.abs
## 1                                        0.9013416
## 2                                        0.9160252
## 3                                        0.8976275
## 4                                        0.9327604
## 5                                        0.8884086
## 6                                        0.8708898
##   Party.fctr.All.X.zv.pca.rcv.glmnet
## 1                                  D
## 2                                  D
## 3                                  D
## 4                                  D
## 5                                  D
## 6                                  D
##   Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## 1                              0.08379167
## 2                              0.12887750
## 3                              0.07930931
## 4                              0.08264309
## 5                              0.12085734
## 6                              0.16475530
##   Party.fctr.All.X.zv.pca.rcv.glmnet.is.acc
## 1                                     FALSE
## 2                                     FALSE
## 3                                     FALSE
## 4                                     FALSE
## 5                                     FALSE
## 6                                     FALSE
##   Party.fctr.All.X.zv.pca.rcv.glmnet.err
## 1                                   TRUE
## 2                                   TRUE
## 3                                   TRUE
## 4                                   TRUE
## 5                                   TRUE
## 6                                   TRUE
##   Party.fctr.All.X.zv.pca.rcv.glmnet.err.abs Party.fctr.RFE.X..rcv.gbm
## 1                                  0.9162083                         D
## 2                                  0.8711225                         D
## 3                                  0.9206907                         D
## 4                                  0.9173569                         D
## 5                                  0.8791427                         D
## 6                                  0.8352447                         D
##   Party.fctr.RFE.X..rcv.gbm.prob Party.fctr.RFE.X..rcv.gbm.is.acc
## 1                     0.11057774                            FALSE
## 2                     0.08547744                            FALSE
## 3                     0.10116155                            FALSE
## 4                     0.06666800                            FALSE
## 5                     0.10193145                            FALSE
## 6                     0.14065050                            FALSE
##   Party.fctr.RFE.X..rcv.gbm.err Party.fctr.RFE.X..rcv.gbm.err.abs
## 1                          TRUE                         0.8894223
## 2                          TRUE                         0.9145226
## 3                          TRUE                         0.8988384
## 4                          TRUE                         0.9333320
## 5                          TRUE                         0.8980685
## 6                          TRUE                         0.8593495
##   Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet
## 1                                               D
## 2                                               D
## 3                                               D
## 4                                               D
## 5                                               D
## 6                                               D
##   Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.prob
## 1                                            0.1777031
## 2                                            0.1654979
## 3                                            0.1818161
## 4                                            0.1575228
## 5                                            0.1445018
## 6                                            0.1617590
##   Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.is.acc
## 1                                                  FALSE
## 2                                                  FALSE
## 3                                                  FALSE
## 4                                                  FALSE
## 5                                                  FALSE
## 6                                                  FALSE
##   Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.err
## 1                                                TRUE
## 2                                                TRUE
## 3                                                TRUE
## 4                                                TRUE
## 5                                                TRUE
## 6                                                TRUE
##   Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.err.abs
## 1                                               0.8222969
## 2                                               0.8345021
## 3                                               0.8181839
## 4                                               0.8424772
## 5                                               0.8554982
## 6                                               0.8382410
##   Party.fctr.RFE.X..rcv.earth Party.fctr.RFE.X..rcv.earth.prob
## 1                           D                       0.05976360
## 2                           D                       0.04754454
## 3                           D                       0.07897377
## 4                           D                       0.04619123
## 5                           D                       0.10257130
## 6                           D                       0.12377526
##   Party.fctr.RFE.X..rcv.earth.is.acc Party.fctr.RFE.X..rcv.earth.err
## 1                              FALSE                            TRUE
## 2                              FALSE                            TRUE
## 3                              FALSE                            TRUE
## 4                              FALSE                            TRUE
## 5                              FALSE                            TRUE
## 6                              FALSE                            TRUE
##   Party.fctr.RFE.X..rcv.earth.err.abs Party.fctr.RFE.X..rcv.glm
## 1                           0.9402364                         D
## 2                           0.9524555                         D
## 3                           0.9210262                         D
## 4                           0.9538088                         D
## 5                           0.8974287                         D
## 6                           0.8762247                         D
##   Party.fctr.RFE.X..rcv.glm.prob Party.fctr.RFE.X..rcv.glm.is.acc
## 1                     0.03621919                            FALSE
## 2                     0.01953030                            FALSE
## 3                     0.01390992                            FALSE
## 4                     0.06644046                            FALSE
## 5                     0.02148219                            FALSE
## 6                     0.07522601                            FALSE
##   Party.fctr.RFE.X..rcv.glm.err Party.fctr.RFE.X..rcv.glm.err.abs
## 1                          TRUE                         0.9637808
## 2                          TRUE                         0.9804697
## 3                          TRUE                         0.9860901
## 4                          TRUE                         0.9335595
## 5                          TRUE                         0.9785178
## 6                          TRUE                         0.9247740
##   Party.fctr.All.X..rcv.glm Party.fctr.All.X..rcv.glm.prob
## 1                         D                     0.03338796
## 2                         D                     0.01900093
## 3                         D                     0.01681927
## 4                         D                     0.08520718
## 5                         D                     0.02091163
## 6                         D                     0.07426748
##   Party.fctr.All.X..rcv.glm.is.acc Party.fctr.All.X..rcv.glm.err
## 1                            FALSE                          TRUE
## 2                            FALSE                          TRUE
## 3                            FALSE                          TRUE
## 4                            FALSE                          TRUE
## 5                            FALSE                          TRUE
## 6                            FALSE                          TRUE
##   Party.fctr.All.X..rcv.glm.err.abs Party.fctr.RFE.X..rcv.rf
## 1                         0.9666120                        R
## 2                         0.9809991                        D
## 3                         0.9831807                        D
## 4                         0.9147928                        D
## 5                         0.9790884                        R
## 6                         0.9257325                        D
##   Party.fctr.RFE.X..rcv.rf.prob Party.fctr.RFE.X..rcv.rf.is.acc
## 1                         0.688                            TRUE
## 2                         0.130                           FALSE
## 3                         0.126                           FALSE
## 4                         0.144                           FALSE
## 5                         0.694                            TRUE
## 6                         0.136                           FALSE
##   Party.fctr.RFE.X..rcv.rf.err Party.fctr.RFE.X..rcv.rf.err.abs
## 1                        FALSE                            0.312
## 2                         TRUE                            0.870
## 3                         TRUE                            0.874
## 4                         TRUE                            0.856
## 5                        FALSE                            0.306
## 6                         TRUE                            0.864
##   Party.fctr.RFE.X..rcv.avNNet Party.fctr.RFE.X..rcv.avNNet.prob
## 1                            D                         0.1699310
## 2                            D                         0.0839713
## 3                            D                         0.0839713
## 4                            D                         0.0839713
## 5                            D                         0.1531859
## 6                            D                         0.1019182
##   Party.fctr.RFE.X..rcv.avNNet.is.acc Party.fctr.RFE.X..rcv.avNNet.err
## 1                               FALSE                             TRUE
## 2                               FALSE                             TRUE
## 3                               FALSE                             TRUE
## 4                               FALSE                             TRUE
## 5                               FALSE                             TRUE
## 6                               FALSE                             TRUE
##   Party.fctr.RFE.X..rcv.avNNet.err.abs Party.fctr.RFE.X..rcv.nnet
## 1                            0.8300690                          D
## 2                            0.9160287                          D
## 3                            0.9160287                          D
## 4                            0.9160287                          D
## 5                            0.8468141                          D
## 6                            0.8980818                          D
##   Party.fctr.RFE.X..rcv.nnet.prob Party.fctr.RFE.X..rcv.nnet.is.acc
## 1                       0.1826732                             FALSE
## 2                       0.1826730                             FALSE
## 3                       0.1826730                             FALSE
## 4                       0.1826738                             FALSE
## 5                       0.1826730                             FALSE
## 6                       0.1826772                             FALSE
##   Party.fctr.RFE.X..rcv.nnet.err Party.fctr.RFE.X..rcv.nnet.err.abs
## 1                           TRUE                          0.8173268
## 2                           TRUE                          0.8173270
## 3                           TRUE                          0.8173270
## 4                           TRUE                          0.8173262
## 5                           TRUE                          0.8173270
## 6                           TRUE                          0.8173228
##   Party.fctr.RFE.X.ica.rcv.glmnet Party.fctr.RFE.X.ica.rcv.glmnet.prob
## 1                               D                            0.4580454
## 2                               D                            0.3743749
## 3                               D                            0.4035507
## 4                               D                            0.4367883
## 5                               D                            0.4052682
## 6                               D                            0.4439758
##   Party.fctr.RFE.X.ica.rcv.glmnet.is.acc
## 1                                  FALSE
## 2                                  FALSE
## 3                                  FALSE
## 4                                  FALSE
## 5                                  FALSE
## 6                                  FALSE
##   Party.fctr.RFE.X.ica.rcv.glmnet.err
## 1                                TRUE
## 2                                TRUE
## 3                                TRUE
## 4                                TRUE
## 5                                TRUE
## 6                                TRUE
##   Party.fctr.RFE.X.ica.rcv.glmnet.err.abs Party.fctr.All.X.ica.rcv.glmnet
## 1                               0.5419546                               D
## 2                               0.6256251                               D
## 3                               0.5964493                               D
## 4                               0.5632117                               D
## 5                               0.5947318                               D
## 6                               0.5560242                               D
##   Party.fctr.All.X.ica.rcv.glmnet.prob
## 1                            0.4596169
## 2                            0.3795166
## 3                            0.3966073
## 4                            0.4345821
## 5                            0.4061550
## 6                            0.4378205
##   Party.fctr.All.X.ica.rcv.glmnet.is.acc
## 1                                  FALSE
## 2                                  FALSE
## 3                                  FALSE
## 4                                  FALSE
## 5                                  FALSE
## 6                                  FALSE
##   Party.fctr.All.X.ica.rcv.glmnet.err
## 1                                TRUE
## 2                                TRUE
## 3                                TRUE
## 4                                TRUE
## 5                                TRUE
## 6                                TRUE
##   Party.fctr.All.X.ica.rcv.glmnet.err.abs
## 1                               0.5403831
## 2                               0.6204834
## 3                               0.6033927
## 4                               0.5654179
## 5                               0.5938450
## 6                               0.5621795
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet
## 1                                          D
## 2                                          D
## 3                                          D
## 4                                          D
## 5                                          D
## 6                                          D
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## 1                                      0.08107864
## 2                                      0.13715343
## 3                                      0.11860055
## 4                                      0.15979667
## 5                                      0.18304388
## 6                                      0.05425116
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.is.acc
## 1                                             FALSE
## 2                                             FALSE
## 3                                             FALSE
## 4                                             FALSE
## 5                                             FALSE
## 6                                             FALSE
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.err
## 1                                           TRUE
## 2                                           TRUE
## 3                                           TRUE
## 4                                           TRUE
## 5                                           TRUE
## 6                                           TRUE
##   Party.fctr.Interact.High.cor.Y..rcv.glmnet.err.abs
## 1                                          0.9189214
## 2                                          0.8628466
## 3                                          0.8813995
## 4                                          0.8402033
## 5                                          0.8169561
## 6                                          0.9457488
##   Party.fctr.Ensemble.auto.2..rcv.glmnet.prob
## 1                                  0.08286439
## 2                                          NA
## 3                                          NA
## 4                                          NA
## 5                                  0.08756964
## 6                                          NA
##   Party.fctr.Ensemble.auto.2..rcv.glmnet
## 1                                      D
## 2                                   <NA>
## 3                                   <NA>
## 4                                   <NA>
## 5                                      D
## 6                                   <NA>
##   Party.fctr.Ensemble.auto.2..rcv.glmnet.err
## 1                                       TRUE
## 2                                         NA
## 3                                         NA
## 4                                         NA
## 5                                       TRUE
## 6                                         NA
##   Party.fctr.Ensemble.auto.2..rcv.glmnet.err.abs
## 1                                      0.9171356
## 2                                             NA
## 3                                             NA
## 4                                             NA
## 5                                      0.9124304
## 6                                             NA
##   Party.fctr.Ensemble.auto.2..rcv.glmnet.is.acc
## 1                                         FALSE
## 2                                            NA
## 3                                            NA
## 4                                            NA
## 5                                         FALSE
## 6                                            NA
##   Party.fctr.Final.RFE.X.Inc..rcv.bagEarth.prob
## 1                                    0.08310805
## 2                                    0.08610248
## 3                                    0.09317883
## 4                                    0.09701839
## 5                                    0.10419995
## 6                                    0.11198014
##   Party.fctr.Final.RFE.X.Inc..rcv.bagEarth
## 1                                        D
## 2                                        D
## 3                                        D
## 4                                        D
## 5                                        D
## 6                                        D
##   Party.fctr.Final.RFE.X.Inc..rcv.bagEarth.err
## 1                                         TRUE
## 2                                         TRUE
## 3                                         TRUE
## 4                                         TRUE
## 5                                         TRUE
## 6                                         TRUE
##   Party.fctr.Final.RFE.X.Inc..rcv.bagEarth.err.abs
## 1                                        0.9168919
## 2                                        0.9138975
## 3                                        0.9068212
## 4                                        0.9029816
## 5                                        0.8958000
## 6                                        0.8880199
##   Party.fctr.Final.RFE.X.Inc..rcv.bagEarth.is.acc
## 1                                           FALSE
## 2                                           FALSE
## 3                                           FALSE
## 4                                           FALSE
## 5                                           FALSE
## 6                                           FALSE
##   Party.fctr.Final.All.X.ica.rcv.glmnet.prob
## 1                                  0.4596169
## 2                                  0.3795166
## 3                                  0.3966073
## 4                                  0.4345821
## 5                                  0.4061550
## 6                                  0.4378205
##   Party.fctr.Final.All.X.ica.rcv.glmnet
## 1                                     D
## 2                                     D
## 3                                     D
## 4                                     D
## 5                                     D
## 6                                     D
##   Party.fctr.Final.All.X.ica.rcv.glmnet.err
## 1                                      TRUE
## 2                                      TRUE
## 3                                      TRUE
## 4                                      TRUE
## 5                                      TRUE
## 6                                      TRUE
##   Party.fctr.Final.All.X.ica.rcv.glmnet.err.abs
## 1                                     0.5403831
## 2                                     0.6204834
## 3                                     0.6033927
## 4                                     0.5654179
## 5                                     0.5938450
## 6                                     0.5621795
##   Party.fctr.Final.All.X.ica.rcv.glmnet.is.acc
## 1                                        FALSE
## 2                                        FALSE
## 3                                        FALSE
## 4                                        FALSE
## 5                                        FALSE
## 6                                        FALSE
##   Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.prob
## 1                                        0.09163359
## 2                                        0.09664980
## 3                                        0.09925963
## 4                                        0.09933112
## 5                                        0.10429225
## 6                                        0.10671234
##   Party.fctr.Final.Ensemble.auto.2..rcv.glmnet
## 1                                            D
## 2                                            D
## 3                                            D
## 4                                            D
## 5                                            D
## 6                                            D
##   Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.err
## 1                                             TRUE
## 2                                             TRUE
## 3                                             TRUE
## 4                                             TRUE
## 5                                             TRUE
## 6                                             TRUE
##   Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.err.abs
## 1                                            0.9083664
## 2                                            0.9033502
## 3                                            0.9007404
## 4                                            0.9006689
## 5                                            0.8957077
## 6                                            0.8932877
##   Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.is.acc
## 1                                               FALSE
## 2                                               FALSE
## 3                                               FALSE
## 4                                               FALSE
## 5                                               FALSE
## 6                                               FALSE
##   Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.accurate
## 1                                                 FALSE
## 2                                                 FALSE
## 3                                                 FALSE
## 4                                                 FALSE
## 5                                                 FALSE
## 6                                                 FALSE
##   Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.error
## 1                                         -0.5583664
## 2                                         -0.5533502
## 3                                         -0.5507404
## 4                                         -0.5506689
## 5                                         -0.5457077
## 6                                         -0.5432877
##      USER_ID Party.fctr Party.fctr.RFE.X.Inc..rcv.bagEarth
## 285     3344          R                                  D
## 1126    6874          R                                  D
## 1289    3835          R                                  D
## 1483    5297          R                                  D
## 1515    5621          R                                  D
## 1869     385          D                                  D
##      Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## 285                                0.3592399
## 1126                               0.5153332
## 1289                               0.5337344
## 1483                               0.5547348
## 1515                               0.5627490
## 1869                               0.6369772
##      Party.fctr.RFE.X.Inc..rcv.bagEarth.is.acc
## 285                                      FALSE
## 1126                                     FALSE
## 1289                                     FALSE
## 1483                                     FALSE
## 1515                                     FALSE
## 1869                                      TRUE
##      Party.fctr.RFE.X.Inc..rcv.bagEarth.err
## 285                                    TRUE
## 1126                                   TRUE
## 1289                                   TRUE
## 1483                                   TRUE
## 1515                                   TRUE
## 1869                                  FALSE
##      Party.fctr.RFE.X.Inc..rcv.bagEarth.err.abs
## 285                                   0.6407601
## 1126                                  0.4846668
## 1289                                  0.4662656
## 1483                                  0.4452652
## 1515                                  0.4372510
## 1869                                  0.6369772
##      Party.fctr.RFE.X..rcv.bagEarth Party.fctr.RFE.X..rcv.bagEarth.prob
## 285                               D                           0.3260053
## 1126                              D                           0.5395491
## 1289                              D                           0.5212445
## 1483                              D                           0.5421782
## 1515                              D                           0.5706701
## 1869                              D                           0.5263214
##      Party.fctr.RFE.X..rcv.bagEarth.is.acc
## 285                                  FALSE
## 1126                                 FALSE
## 1289                                 FALSE
## 1483                                 FALSE
## 1515                                 FALSE
## 1869                                  TRUE
##      Party.fctr.RFE.X..rcv.bagEarth.err
## 285                                TRUE
## 1126                               TRUE
## 1289                               TRUE
## 1483                               TRUE
## 1515                               TRUE
## 1869                              FALSE
##      Party.fctr.RFE.X..rcv.bagEarth.err.abs
## 285                               0.6739947
## 1126                              0.4604509
## 1289                              0.4787555
## 1483                              0.4578218
## 1515                              0.4293299
## 1869                              0.5263214
##      Party.fctr.RFE.X.zv.pca.rcv.glmnet
## 285                                   D
## 1126                                  R
## 1289                                  D
## 1483                                  R
## 1515                                  R
## 1869                                  R
##      Party.fctr.RFE.X.zv.pca.rcv.glmnet.prob
## 285                                0.2851134
## 1126                               0.5773544
## 1289                               0.4828871
## 1483                               0.5289404
## 1515                               0.5693353
## 1869                               0.5233256
##      Party.fctr.RFE.X.zv.pca.rcv.glmnet.is.acc
## 285                                      FALSE
## 1126                                      TRUE
## 1289                                     FALSE
## 1483                                      TRUE
## 1515                                      TRUE
## 1869                                     FALSE
##      Party.fctr.RFE.X.zv.pca.rcv.glmnet.err
## 285                                    TRUE
## 1126                                  FALSE
## 1289                                   TRUE
## 1483                                  FALSE
## 1515                                  FALSE
## 1869                                   TRUE
##      Party.fctr.RFE.X.zv.pca.rcv.glmnet.err.abs
## 285                                   0.7148866
## 1126                                  0.4226456
## 1289                                  0.5171129
## 1483                                  0.4710596
## 1515                                  0.4306647
## 1869                                  0.5233256
##      Party.fctr.All.X.nzv.spatialSign.rcv.glmnet
## 285                                            D
## 1126                                           D
## 1289                                           D
## 1483                                           D
## 1515                                           D
## 1869                                           D
##      Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## 285                                         0.3059115
## 1126                                        0.5617398
## 1289                                        0.5371047
## 1483                                        0.5139915
## 1515                                        0.5449981
## 1869                                        0.5550532
##      Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.is.acc
## 285                                               FALSE
## 1126                                              FALSE
## 1289                                              FALSE
## 1483                                              FALSE
## 1515                                              FALSE
## 1869                                               TRUE
##      Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.err
## 285                                             TRUE
## 1126                                            TRUE
## 1289                                            TRUE
## 1483                                            TRUE
## 1515                                            TRUE
## 1869                                           FALSE
##      Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.err.abs
## 285                                            0.6940885
## 1126                                           0.4382602
## 1289                                           0.4628953
## 1483                                           0.4860085
## 1515                                           0.4550019
## 1869                                           0.5550532
##      Party.fctr.All.X.spatialSign.rcv.glmnet
## 285                                        D
## 1126                                       D
## 1289                                       D
## 1483                                       D
## 1515                                       D
## 1869                                       D
##      Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## 285                                     0.3727105
## 1126                                    0.5472416
## 1289                                    0.5308677
## 1483                                    0.4848152
## 1515                                    0.5880719
## 1869                                    0.5980043
##      Party.fctr.All.X.spatialSign.rcv.glmnet.is.acc
## 285                                           FALSE
## 1126                                          FALSE
## 1289                                          FALSE
## 1483                                          FALSE
## 1515                                          FALSE
## 1869                                           TRUE
##      Party.fctr.All.X.spatialSign.rcv.glmnet.err
## 285                                         TRUE
## 1126                                        TRUE
## 1289                                        TRUE
## 1483                                        TRUE
## 1515                                        TRUE
## 1869                                       FALSE
##      Party.fctr.All.X.spatialSign.rcv.glmnet.err.abs
## 285                                        0.6272895
## 1126                                       0.4527584
## 1289                                       0.4691323
## 1483                                       0.5151848
## 1515                                       0.4119281
## 1869                                       0.5980043
##      Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet
## 285                                            D
## 1126                                           D
## 1289                                           D
## 1483                                           D
## 1515                                           D
## 1869                                           D
##      Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.prob
## 285                                         0.2936859
## 1126                                        0.5616766
## 1289                                        0.5375654
## 1483                                        0.5175732
## 1515                                        0.5436505
## 1869                                        0.5554812
##      Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.is.acc
## 285                                               FALSE
## 1126                                              FALSE
## 1289                                              FALSE
## 1483                                              FALSE
## 1515                                              FALSE
## 1869                                               TRUE
##      Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.err
## 285                                             TRUE
## 1126                                            TRUE
## 1289                                            TRUE
## 1483                                            TRUE
## 1515                                            TRUE
## 1869                                           FALSE
##      Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.err.abs
## 285                                            0.7063141
## 1126                                           0.4383234
## 1289                                           0.4624346
## 1483                                           0.4824268
## 1515                                           0.4563495
## 1869                                           0.5554812
##      Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet
## 285                                                D
## 1126                                               D
## 1289                                               D
## 1483                                               D
## 1515                                               D
## 1869                                               D
##      Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.prob
## 285                                             0.3124278
## 1126                                            0.5682957
## 1289                                            0.5387563
## 1483                                            0.5137115
## 1515                                            0.5349963
## 1869                                            0.5794779
##      Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.is.acc
## 285                                                   FALSE
## 1126                                                  FALSE
## 1289                                                  FALSE
## 1483                                                  FALSE
## 1515                                                  FALSE
## 1869                                                   TRUE
##      Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.err
## 285                                                 TRUE
## 1126                                                TRUE
## 1289                                                TRUE
## 1483                                                TRUE
## 1515                                                TRUE
## 1869                                               FALSE
##      Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.err.abs
## 285                                                0.6875722
## 1126                                               0.4317043
## 1289                                               0.4612437
## 1483                                               0.4862885
## 1515                                               0.4650037
## 1869                                               0.5794779
##      Party.fctr.RFE.X.spatialSign.rcv.glmnet
## 285                                        D
## 1126                                       D
## 1289                                       D
## 1483                                       D
## 1515                                       D
## 1869                                       D
##      Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## 285                                     0.3693860
## 1126                                    0.5471723
## 1289                                    0.5307636
## 1483                                    0.4846465
## 1515                                    0.5879602
## 1869                                    0.5983457
##      Party.fctr.RFE.X.spatialSign.rcv.glmnet.is.acc
## 285                                           FALSE
## 1126                                          FALSE
## 1289                                          FALSE
## 1483                                          FALSE
## 1515                                          FALSE
## 1869                                           TRUE
##      Party.fctr.RFE.X.spatialSign.rcv.glmnet.err
## 285                                         TRUE
## 1126                                        TRUE
## 1289                                        TRUE
## 1483                                        TRUE
## 1515                                        TRUE
## 1869                                       FALSE
##      Party.fctr.RFE.X.spatialSign.rcv.glmnet.err.abs
## 285                                        0.6306140
## 1126                                       0.4528277
## 1289                                       0.4692364
## 1483                                       0.5153535
## 1515                                       0.4120398
## 1869                                       0.5983457
##      Party.fctr.All.X.nzv.rcv.glmnet Party.fctr.All.X.nzv.rcv.glmnet.prob
## 285                                D                            0.3061689
## 1126                               D                            0.5417313
## 1289                               D                            0.5210544
## 1483                               D                            0.4877016
## 1515                               D                            0.5377228
## 1869                               D                            0.5630101
##      Party.fctr.All.X.nzv.rcv.glmnet.is.acc
## 285                                   FALSE
## 1126                                  FALSE
## 1289                                  FALSE
## 1483                                  FALSE
## 1515                                  FALSE
## 1869                                   TRUE
##      Party.fctr.All.X.nzv.rcv.glmnet.err
## 285                                 TRUE
## 1126                                TRUE
## 1289                                TRUE
## 1483                                TRUE
## 1515                                TRUE
## 1869                               FALSE
##      Party.fctr.All.X.nzv.rcv.glmnet.err.abs
## 285                                0.6938311
## 1126                               0.4582687
## 1289                               0.4789456
## 1483                               0.5122984
## 1515                               0.4622772
## 1869                               0.5630101
##      Party.fctr.RFE.X.nzv.rcv.glmnet Party.fctr.RFE.X.nzv.rcv.glmnet.prob
## 285                                D                            0.3045716
## 1126                               D                            0.5412540
## 1289                               D                            0.5205066
## 1483                               D                            0.4921604
## 1515                               D                            0.5351052
## 1869                               R                            0.5632399
##      Party.fctr.RFE.X.nzv.rcv.glmnet.is.acc
## 285                                   FALSE
## 1126                                  FALSE
## 1289                                  FALSE
## 1483                                  FALSE
## 1515                                  FALSE
## 1869                                  FALSE
##      Party.fctr.RFE.X.nzv.rcv.glmnet.err
## 285                                 TRUE
## 1126                                TRUE
## 1289                                TRUE
## 1483                                TRUE
## 1515                                TRUE
## 1869                                TRUE
##      Party.fctr.RFE.X.nzv.rcv.glmnet.err.abs
## 285                                0.6954284
## 1126                               0.4587460
## 1289                               0.4794934
## 1483                               0.5078396
## 1515                               0.4648948
## 1869                               0.5632399
##      Party.fctr.All.X.expoTrans.rcv.glmnet
## 285                                      D
## 1126                                     D
## 1289                                     D
## 1483                                     D
## 1515                                     R
## 1869                                     R
##      Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## 285                                   0.3829496
## 1126                                  0.5276189
## 1289                                  0.5296338
## 1483                                  0.4709054
## 1515                                  0.5787691
## 1869                                  0.6079587
##      Party.fctr.All.X.expoTrans.rcv.glmnet.is.acc
## 285                                         FALSE
## 1126                                        FALSE
## 1289                                        FALSE
## 1483                                        FALSE
## 1515                                         TRUE
## 1869                                        FALSE
##      Party.fctr.All.X.expoTrans.rcv.glmnet.err
## 285                                       TRUE
## 1126                                      TRUE
## 1289                                      TRUE
## 1483                                      TRUE
## 1515                                     FALSE
## 1869                                      TRUE
##      Party.fctr.All.X.expoTrans.rcv.glmnet.err.abs
## 285                                      0.6170504
## 1126                                     0.4723811
## 1289                                     0.4703662
## 1483                                     0.5290946
## 1515                                     0.4212309
## 1869                                     0.6079587
##      Party.fctr.RFE.X.expoTrans.rcv.glmnet
## 285                                      D
## 1126                                     D
## 1289                                     D
## 1483                                     D
## 1515                                     R
## 1869                                     R
##      Party.fctr.RFE.X.expoTrans.rcv.glmnet.prob
## 285                                   0.3829496
## 1126                                  0.5276189
## 1289                                  0.5296338
## 1483                                  0.4709054
## 1515                                  0.5787691
## 1869                                  0.6079587
##      Party.fctr.RFE.X.expoTrans.rcv.glmnet.is.acc
## 285                                         FALSE
## 1126                                        FALSE
## 1289                                        FALSE
## 1483                                        FALSE
## 1515                                         TRUE
## 1869                                        FALSE
##      Party.fctr.RFE.X.expoTrans.rcv.glmnet.err
## 285                                       TRUE
## 1126                                      TRUE
## 1289                                      TRUE
## 1483                                      TRUE
## 1515                                     FALSE
## 1869                                      TRUE
##      Party.fctr.RFE.X.expoTrans.rcv.glmnet.err.abs
## 285                                      0.6170504
## 1126                                     0.4723811
## 1289                                     0.4703662
## 1483                                     0.5290946
## 1515                                     0.4212309
## 1869                                     0.6079587
##      Party.fctr.All.X.YeoJohnson.rcv.glmnet
## 285                                       D
## 1126                                      D
## 1289                                      D
## 1483                                      D
## 1515                                      R
## 1869                                      R
##      Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## 285                                    0.3829347
## 1126                                   0.5275999
## 1289                                   0.5296755
## 1483                                   0.4710073
## 1515                                   0.5789336
## 1869                                   0.6080884
##      Party.fctr.All.X.YeoJohnson.rcv.glmnet.is.acc
## 285                                          FALSE
## 1126                                         FALSE
## 1289                                         FALSE
## 1483                                         FALSE
## 1515                                          TRUE
## 1869                                         FALSE
##      Party.fctr.All.X.YeoJohnson.rcv.glmnet.err
## 285                                        TRUE
## 1126                                       TRUE
## 1289                                       TRUE
## 1483                                       TRUE
## 1515                                      FALSE
## 1869                                       TRUE
##      Party.fctr.All.X.YeoJohnson.rcv.glmnet.err.abs
## 285                                       0.6170653
## 1126                                      0.4724001
## 1289                                      0.4703245
## 1483                                      0.5289927
## 1515                                      0.4210664
## 1869                                      0.6080884
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet
## 285                                       D
## 1126                                      D
## 1289                                      D
## 1483                                      D
## 1515                                      R
## 1869                                      R
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## 285                                    0.3829347
## 1126                                   0.5275999
## 1289                                   0.5296755
## 1483                                   0.4710073
## 1515                                   0.5789336
## 1869                                   0.6080884
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.is.acc
## 285                                          FALSE
## 1126                                         FALSE
## 1289                                         FALSE
## 1483                                         FALSE
## 1515                                          TRUE
## 1869                                         FALSE
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.err
## 285                                        TRUE
## 1126                                       TRUE
## 1289                                       TRUE
## 1483                                       TRUE
## 1515                                      FALSE
## 1869                                       TRUE
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.err.abs
## 285                                       0.6170653
## 1126                                      0.4724001
## 1289                                      0.4703245
## 1483                                      0.5289927
## 1515                                      0.4210664
## 1869                                      0.6080884
##      Party.fctr.RFE.X..rcv.rpart Party.fctr.RFE.X..rcv.rpart.prob
## 285                            D                        0.4638143
## 1126                           D                        0.4638143
## 1289                           R                        0.6666667
## 1483                           D                        0.4638143
## 1515                           R                        0.6035857
## 1869                           R                        0.6035857
##      Party.fctr.RFE.X..rcv.rpart.is.acc Party.fctr.RFE.X..rcv.rpart.err
## 285                               FALSE                            TRUE
## 1126                              FALSE                            TRUE
## 1289                               TRUE                           FALSE
## 1483                              FALSE                            TRUE
## 1515                               TRUE                           FALSE
## 1869                              FALSE                            TRUE
##      Party.fctr.RFE.X..rcv.rpart.err.abs Party.fctr.RFE.X..rcv.glmnet
## 285                            0.5361857                            D
## 1126                           0.5361857                            D
## 1289                           0.3333333                            D
## 1483                           0.5361857                            D
## 1515                           0.3964143                            R
## 1869                           0.6035857                            R
##      Party.fctr.RFE.X..rcv.glmnet.prob Party.fctr.RFE.X..rcv.glmnet.is.acc
## 285                          0.3830267                               FALSE
## 1126                         0.5265698                               FALSE
## 1289                         0.5139073                               FALSE
## 1483                         0.4711044                               FALSE
## 1515                         0.5776177                                TRUE
## 1869                         0.6086434                               FALSE
##      Party.fctr.RFE.X..rcv.glmnet.err Party.fctr.RFE.X..rcv.glmnet.err.abs
## 285                              TRUE                            0.6169733
## 1126                             TRUE                            0.4734302
## 1289                             TRUE                            0.4860927
## 1483                             TRUE                            0.5288956
## 1515                            FALSE                            0.4223823
## 1869                             TRUE                            0.6086434
##      Party.fctr.All.X.conditionalX.rcv.glmnet
## 285                                         D
## 1126                                        D
## 1289                                        D
## 1483                                        D
## 1515                                        R
## 1869                                        R
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## 285                                      0.3830267
## 1126                                     0.5265698
## 1289                                     0.5139073
## 1483                                     0.4711044
## 1515                                     0.5776177
## 1869                                     0.6086434
##      Party.fctr.All.X.conditionalX.rcv.glmnet.is.acc
## 285                                            FALSE
## 1126                                           FALSE
## 1289                                           FALSE
## 1483                                           FALSE
## 1515                                            TRUE
## 1869                                           FALSE
##      Party.fctr.All.X.conditionalX.rcv.glmnet.err
## 285                                          TRUE
## 1126                                         TRUE
## 1289                                         TRUE
## 1483                                         TRUE
## 1515                                        FALSE
## 1869                                         TRUE
##      Party.fctr.All.X.conditionalX.rcv.glmnet.err.abs
## 285                                         0.6169733
## 1126                                        0.4734302
## 1289                                        0.4860927
## 1483                                        0.5288956
## 1515                                        0.4223823
## 1869                                        0.6086434
##      Party.fctr.All.X..rcv.glmnet Party.fctr.All.X..rcv.glmnet.prob
## 285                             D                         0.3830267
## 1126                            D                         0.5265698
## 1289                            D                         0.5139073
## 1483                            D                         0.4711044
## 1515                            R                         0.5776177
## 1869                            R                         0.6086434
##      Party.fctr.All.X..rcv.glmnet.is.acc Party.fctr.All.X..rcv.glmnet.err
## 285                                FALSE                             TRUE
## 1126                               FALSE                             TRUE
## 1289                               FALSE                             TRUE
## 1483                               FALSE                             TRUE
## 1515                                TRUE                            FALSE
## 1869                               FALSE                             TRUE
##      Party.fctr.All.X..rcv.glmnet.err.abs Party.fctr.Low.cor.X..rcv.glmnet
## 285                             0.6169733                                D
## 1126                            0.4734302                                D
## 1289                            0.4860927                                D
## 1483                            0.5288956                                D
## 1515                            0.4223823                                R
## 1869                            0.6086434                                R
##      Party.fctr.Low.cor.X..rcv.glmnet.prob
## 285                              0.3830267
## 1126                             0.5265698
## 1289                             0.5139073
## 1483                             0.4711044
## 1515                             0.5776177
## 1869                             0.6086434
##      Party.fctr.Low.cor.X..rcv.glmnet.is.acc
## 285                                    FALSE
## 1126                                   FALSE
## 1289                                   FALSE
## 1483                                   FALSE
## 1515                                    TRUE
## 1869                                   FALSE
##      Party.fctr.Low.cor.X..rcv.glmnet.err
## 285                                  TRUE
## 1126                                 TRUE
## 1289                                 TRUE
## 1483                                 TRUE
## 1515                                FALSE
## 1869                                 TRUE
##      Party.fctr.Low.cor.X..rcv.glmnet.err.abs
## 285                                 0.6169733
## 1126                                0.4734302
## 1289                                0.4860927
## 1483                                0.5288956
## 1515                                0.4223823
## 1869                                0.6086434
##      Party.fctr.RFE.X.conditionalX.rcv.glmnet
## 285                                         D
## 1126                                        D
## 1289                                        D
## 1483                                        D
## 1515                                        R
## 1869                                        R
##      Party.fctr.RFE.X.conditionalX.rcv.glmnet.prob
## 285                                      0.3830267
## 1126                                     0.5265698
## 1289                                     0.5139073
## 1483                                     0.4711044
## 1515                                     0.5776177
## 1869                                     0.6086434
##      Party.fctr.RFE.X.conditionalX.rcv.glmnet.is.acc
## 285                                            FALSE
## 1126                                           FALSE
## 1289                                           FALSE
## 1483                                           FALSE
## 1515                                            TRUE
## 1869                                           FALSE
##      Party.fctr.RFE.X.conditionalX.rcv.glmnet.err
## 285                                          TRUE
## 1126                                         TRUE
## 1289                                         TRUE
## 1483                                         TRUE
## 1515                                        FALSE
## 1869                                         TRUE
##      Party.fctr.RFE.X.conditionalX.rcv.glmnet.err.abs
## 285                                         0.6169733
## 1126                                        0.4734302
## 1289                                        0.4860927
## 1483                                        0.5288956
## 1515                                        0.4223823
## 1869                                        0.6086434
##      Party.fctr.All.X.zv.rcv.glmnet Party.fctr.All.X.zv.rcv.glmnet.prob
## 285                               D                           0.3830267
## 1126                              D                           0.5265698
## 1289                              D                           0.5139073
## 1483                              D                           0.4711044
## 1515                              R                           0.5776177
## 1869                              R                           0.6086434
##      Party.fctr.All.X.zv.rcv.glmnet.is.acc
## 285                                  FALSE
## 1126                                 FALSE
## 1289                                 FALSE
## 1483                                 FALSE
## 1515                                  TRUE
## 1869                                 FALSE
##      Party.fctr.All.X.zv.rcv.glmnet.err
## 285                                TRUE
## 1126                               TRUE
## 1289                               TRUE
## 1483                               TRUE
## 1515                              FALSE
## 1869                               TRUE
##      Party.fctr.All.X.zv.rcv.glmnet.err.abs Party.fctr.RFE.X.zv.rcv.glmnet
## 285                               0.6169733                              D
## 1126                              0.4734302                              D
## 1289                              0.4860927                              D
## 1483                              0.5288956                              D
## 1515                              0.4223823                              R
## 1869                              0.6086434                              R
##      Party.fctr.RFE.X.zv.rcv.glmnet.prob
## 285                            0.3830267
## 1126                           0.5265698
## 1289                           0.5139073
## 1483                           0.4711044
## 1515                           0.5776177
## 1869                           0.6086434
##      Party.fctr.RFE.X.zv.rcv.glmnet.is.acc
## 285                                  FALSE
## 1126                                 FALSE
## 1289                                 FALSE
## 1483                                 FALSE
## 1515                                  TRUE
## 1869                                 FALSE
##      Party.fctr.RFE.X.zv.rcv.glmnet.err
## 285                                TRUE
## 1126                               TRUE
## 1289                               TRUE
## 1483                               TRUE
## 1515                              FALSE
## 1869                               TRUE
##      Party.fctr.RFE.X.zv.rcv.glmnet.err.abs
## 285                               0.6169733
## 1126                              0.4734302
## 1289                              0.4860927
## 1483                              0.5288956
## 1515                              0.4223823
## 1869                              0.6086434
##      Party.fctr.RFE.X.scale.rcv.glmnet
## 285                                  D
## 1126                                 D
## 1289                                 D
## 1483                                 D
## 1515                                 R
## 1869                                 R
##      Party.fctr.RFE.X.scale.rcv.glmnet.prob
## 285                               0.3830267
## 1126                              0.5265698
## 1289                              0.5139073
## 1483                              0.4711044
## 1515                              0.5776177
## 1869                              0.6086434
##      Party.fctr.RFE.X.scale.rcv.glmnet.is.acc
## 285                                     FALSE
## 1126                                    FALSE
## 1289                                    FALSE
## 1483                                    FALSE
## 1515                                     TRUE
## 1869                                    FALSE
##      Party.fctr.RFE.X.scale.rcv.glmnet.err
## 285                                   TRUE
## 1126                                  TRUE
## 1289                                  TRUE
## 1483                                  TRUE
## 1515                                 FALSE
## 1869                                  TRUE
##      Party.fctr.RFE.X.scale.rcv.glmnet.err.abs
## 285                                  0.6169733
## 1126                                 0.4734302
## 1289                                 0.4860927
## 1483                                 0.5288956
## 1515                                 0.4223823
## 1869                                 0.6086434
##      Party.fctr.RFE.X.center.rcv.glmnet
## 285                                   D
## 1126                                  D
## 1289                                  D
## 1483                                  D
## 1515                                  R
## 1869                                  R
##      Party.fctr.RFE.X.center.rcv.glmnet.prob
## 285                                0.3830267
## 1126                               0.5265698
## 1289                               0.5139073
## 1483                               0.4711044
## 1515                               0.5776177
## 1869                               0.6086434
##      Party.fctr.RFE.X.center.rcv.glmnet.is.acc
## 285                                      FALSE
## 1126                                     FALSE
## 1289                                     FALSE
## 1483                                     FALSE
## 1515                                      TRUE
## 1869                                     FALSE
##      Party.fctr.RFE.X.center.rcv.glmnet.err
## 285                                    TRUE
## 1126                                   TRUE
## 1289                                   TRUE
## 1483                                   TRUE
## 1515                                  FALSE
## 1869                                   TRUE
##      Party.fctr.RFE.X.center.rcv.glmnet.err.abs
## 285                                   0.6169733
## 1126                                  0.4734302
## 1289                                  0.4860927
## 1483                                  0.5288956
## 1515                                  0.4223823
## 1869                                  0.6086434
##      Party.fctr.All.X.scale.rcv.glmnet
## 285                                  D
## 1126                                 D
## 1289                                 D
## 1483                                 D
## 1515                                 R
## 1869                                 R
##      Party.fctr.All.X.scale.rcv.glmnet.prob
## 285                               0.3830267
## 1126                              0.5265698
## 1289                              0.5139073
## 1483                              0.4711044
## 1515                              0.5776177
## 1869                              0.6086434
##      Party.fctr.All.X.scale.rcv.glmnet.is.acc
## 285                                     FALSE
## 1126                                    FALSE
## 1289                                    FALSE
## 1483                                    FALSE
## 1515                                     TRUE
## 1869                                    FALSE
##      Party.fctr.All.X.scale.rcv.glmnet.err
## 285                                   TRUE
## 1126                                  TRUE
## 1289                                  TRUE
## 1483                                  TRUE
## 1515                                 FALSE
## 1869                                  TRUE
##      Party.fctr.All.X.scale.rcv.glmnet.err.abs
## 285                                  0.6169733
## 1126                                 0.4734302
## 1289                                 0.4860927
## 1483                                 0.5288956
## 1515                                 0.4223823
## 1869                                 0.6086434
##      Party.fctr.All.X.center.rcv.glmnet
## 285                                   D
## 1126                                  D
## 1289                                  D
## 1483                                  D
## 1515                                  R
## 1869                                  R
##      Party.fctr.All.X.center.rcv.glmnet.prob
## 285                                0.3830267
## 1126                               0.5265698
## 1289                               0.5139073
## 1483                               0.4711044
## 1515                               0.5776177
## 1869                               0.6086434
##      Party.fctr.All.X.center.rcv.glmnet.is.acc
## 285                                      FALSE
## 1126                                     FALSE
## 1289                                     FALSE
## 1483                                     FALSE
## 1515                                      TRUE
## 1869                                     FALSE
##      Party.fctr.All.X.center.rcv.glmnet.err
## 285                                    TRUE
## 1126                                   TRUE
## 1289                                   TRUE
## 1483                                   TRUE
## 1515                                  FALSE
## 1869                                   TRUE
##      Party.fctr.All.X.center.rcv.glmnet.err.abs
## 285                                   0.6169733
## 1126                                  0.4734302
## 1289                                  0.4860927
## 1483                                  0.5288956
## 1515                                  0.4223823
## 1869                                  0.6086434
##      Party.fctr.RFE.X.range.rcv.glmnet
## 285                                  D
## 1126                                 D
## 1289                                 D
## 1483                                 D
## 1515                                 R
## 1869                                 R
##      Party.fctr.RFE.X.range.rcv.glmnet.prob
## 285                               0.3830267
## 1126                              0.5265698
## 1289                              0.5139073
## 1483                              0.4711044
## 1515                              0.5776177
## 1869                              0.6086434
##      Party.fctr.RFE.X.range.rcv.glmnet.is.acc
## 285                                     FALSE
## 1126                                    FALSE
## 1289                                    FALSE
## 1483                                    FALSE
## 1515                                     TRUE
## 1869                                    FALSE
##      Party.fctr.RFE.X.range.rcv.glmnet.err
## 285                                   TRUE
## 1126                                  TRUE
## 1289                                  TRUE
## 1483                                  TRUE
## 1515                                 FALSE
## 1869                                  TRUE
##      Party.fctr.RFE.X.range.rcv.glmnet.err.abs
## 285                                  0.6169733
## 1126                                 0.4734302
## 1289                                 0.4860927
## 1483                                 0.5288956
## 1515                                 0.4223823
## 1869                                 0.6086434
##      Party.fctr.RFE.X.BoxCox.rcv.glmnet
## 285                                   D
## 1126                                  D
## 1289                                  D
## 1483                                  D
## 1515                                  R
## 1869                                  R
##      Party.fctr.RFE.X.BoxCox.rcv.glmnet.prob
## 285                                0.3830267
## 1126                               0.5265698
## 1289                               0.5139073
## 1483                               0.4711044
## 1515                               0.5776177
## 1869                               0.6086434
##      Party.fctr.RFE.X.BoxCox.rcv.glmnet.is.acc
## 285                                      FALSE
## 1126                                     FALSE
## 1289                                     FALSE
## 1483                                     FALSE
## 1515                                      TRUE
## 1869                                     FALSE
##      Party.fctr.RFE.X.BoxCox.rcv.glmnet.err
## 285                                    TRUE
## 1126                                   TRUE
## 1289                                   TRUE
## 1483                                   TRUE
## 1515                                  FALSE
## 1869                                   TRUE
##      Party.fctr.RFE.X.BoxCox.rcv.glmnet.err.abs
## 285                                   0.6169733
## 1126                                  0.4734302
## 1289                                  0.4860927
## 1483                                  0.5288956
## 1515                                  0.4223823
## 1869                                  0.6086434
##      Party.fctr.All.X.range.rcv.glmnet
## 285                                  D
## 1126                                 D
## 1289                                 D
## 1483                                 D
## 1515                                 R
## 1869                                 R
##      Party.fctr.All.X.range.rcv.glmnet.prob
## 285                               0.3830267
## 1126                              0.5265698
## 1289                              0.5139073
## 1483                              0.4711044
## 1515                              0.5776177
## 1869                              0.6086434
##      Party.fctr.All.X.range.rcv.glmnet.is.acc
## 285                                     FALSE
## 1126                                    FALSE
## 1289                                    FALSE
## 1483                                    FALSE
## 1515                                     TRUE
## 1869                                    FALSE
##      Party.fctr.All.X.range.rcv.glmnet.err
## 285                                   TRUE
## 1126                                  TRUE
## 1289                                  TRUE
## 1483                                  TRUE
## 1515                                 FALSE
## 1869                                  TRUE
##      Party.fctr.All.X.range.rcv.glmnet.err.abs
## 285                                  0.6169733
## 1126                                 0.4734302
## 1289                                 0.4860927
## 1483                                 0.5288956
## 1515                                 0.4223823
## 1869                                 0.6086434
##      Party.fctr.All.X.BoxCox.rcv.glmnet
## 285                                   D
## 1126                                  D
## 1289                                  D
## 1483                                  D
## 1515                                  R
## 1869                                  R
##      Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## 285                                0.3830267
## 1126                               0.5265698
## 1289                               0.5139073
## 1483                               0.4711044
## 1515                               0.5776177
## 1869                               0.6086434
##      Party.fctr.All.X.BoxCox.rcv.glmnet.is.acc
## 285                                      FALSE
## 1126                                     FALSE
## 1289                                     FALSE
## 1483                                     FALSE
## 1515                                      TRUE
## 1869                                     FALSE
##      Party.fctr.All.X.BoxCox.rcv.glmnet.err
## 285                                    TRUE
## 1126                                   TRUE
## 1289                                   TRUE
## 1483                                   TRUE
## 1515                                  FALSE
## 1869                                   TRUE
##      Party.fctr.All.X.BoxCox.rcv.glmnet.err.abs
## 285                                   0.6169733
## 1126                                  0.4734302
## 1289                                  0.4860927
## 1483                                  0.5288956
## 1515                                  0.4223823
## 1869                                  0.6086434
##      Party.fctr.RFE.X.center.scale.rcv.glmnet
## 285                                         D
## 1126                                        D
## 1289                                        D
## 1483                                        D
## 1515                                        R
## 1869                                        R
##      Party.fctr.RFE.X.center.scale.rcv.glmnet.prob
## 285                                      0.3830267
## 1126                                     0.5265698
## 1289                                     0.5139073
## 1483                                     0.4711044
## 1515                                     0.5776177
## 1869                                     0.6086434
##      Party.fctr.RFE.X.center.scale.rcv.glmnet.is.acc
## 285                                            FALSE
## 1126                                           FALSE
## 1289                                           FALSE
## 1483                                           FALSE
## 1515                                            TRUE
## 1869                                           FALSE
##      Party.fctr.RFE.X.center.scale.rcv.glmnet.err
## 285                                          TRUE
## 1126                                         TRUE
## 1289                                         TRUE
## 1483                                         TRUE
## 1515                                        FALSE
## 1869                                         TRUE
##      Party.fctr.RFE.X.center.scale.rcv.glmnet.err.abs
## 285                                         0.6169733
## 1126                                        0.4734302
## 1289                                        0.4860927
## 1483                                        0.5288956
## 1515                                        0.4223823
## 1869                                        0.6086434
##      Party.fctr.All.X.center.scale.rcv.glmnet
## 285                                         D
## 1126                                        D
## 1289                                        D
## 1483                                        D
## 1515                                        R
## 1869                                        R
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob
## 285                                      0.3830267
## 1126                                     0.5265698
## 1289                                     0.5139073
## 1483                                     0.4711044
## 1515                                     0.5776177
## 1869                                     0.6086434
##      Party.fctr.All.X.center.scale.rcv.glmnet.is.acc
## 285                                            FALSE
## 1126                                           FALSE
## 1289                                           FALSE
## 1483                                           FALSE
## 1515                                            TRUE
## 1869                                           FALSE
##      Party.fctr.All.X.center.scale.rcv.glmnet.err
## 285                                          TRUE
## 1126                                         TRUE
## 1289                                         TRUE
## 1483                                         TRUE
## 1515                                        FALSE
## 1869                                         TRUE
##      Party.fctr.All.X.center.scale.rcv.glmnet.err.abs
## 285                                         0.6169733
## 1126                                        0.4734302
## 1289                                        0.4860927
## 1483                                        0.5288956
## 1515                                        0.4223823
## 1869                                        0.6086434
##      Party.fctr.All.X.zv.pca.rcv.glmnet
## 285                                   D
## 1126                                  R
## 1289                                  R
## 1483                                  R
## 1515                                  R
## 1869                                  R
##      Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## 285                                0.3005493
## 1126                               0.5554779
## 1289                               0.5132118
## 1483                               0.5340338
## 1515                               0.5117627
## 1869                               0.5008522
##      Party.fctr.All.X.zv.pca.rcv.glmnet.is.acc
## 285                                      FALSE
## 1126                                      TRUE
## 1289                                      TRUE
## 1483                                      TRUE
## 1515                                      TRUE
## 1869                                     FALSE
##      Party.fctr.All.X.zv.pca.rcv.glmnet.err
## 285                                    TRUE
## 1126                                  FALSE
## 1289                                  FALSE
## 1483                                  FALSE
## 1515                                  FALSE
## 1869                                   TRUE
##      Party.fctr.All.X.zv.pca.rcv.glmnet.err.abs Party.fctr.RFE.X..rcv.gbm
## 285                                   0.6994507                         D
## 1126                                  0.4445221                         D
## 1289                                  0.4867882                         D
## 1483                                  0.4659662                         D
## 1515                                  0.4882373                         D
## 1869                                  0.5008522                         D
##      Party.fctr.RFE.X..rcv.gbm.prob Party.fctr.RFE.X..rcv.gbm.is.acc
## 285                       0.3834368                            FALSE
## 1126                      0.5034111                            FALSE
## 1289                      0.5026206                            FALSE
## 1483                      0.5113073                            FALSE
## 1515                      0.5572504                            FALSE
## 1869                      0.5635102                             TRUE
##      Party.fctr.RFE.X..rcv.gbm.err Party.fctr.RFE.X..rcv.gbm.err.abs
## 285                           TRUE                         0.6165632
## 1126                          TRUE                         0.4965889
## 1289                          TRUE                         0.4973794
## 1483                          TRUE                         0.4886927
## 1515                          TRUE                         0.4427496
## 1869                         FALSE                         0.5635102
##      Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet
## 285                                                D
## 1126                                               D
## 1289                                               D
## 1483                                               D
## 1515                                               D
## 1869                                               R
##      Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.prob
## 285                                             0.3812111
## 1126                                            0.4852111
## 1289                                            0.5067967
## 1483                                            0.4971762
## 1515                                            0.4961668
## 1869                                            0.6057089
##      Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.is.acc
## 285                                                   FALSE
## 1126                                                  FALSE
## 1289                                                  FALSE
## 1483                                                  FALSE
## 1515                                                  FALSE
## 1869                                                  FALSE
##      Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.err
## 285                                                 TRUE
## 1126                                                TRUE
## 1289                                                TRUE
## 1483                                                TRUE
## 1515                                                TRUE
## 1869                                                TRUE
##      Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.err.abs
## 285                                                0.6187889
## 1126                                               0.5147889
## 1289                                               0.4932033
## 1483                                               0.5028238
## 1515                                               0.5038332
## 1869                                               0.6057089
##      Party.fctr.RFE.X..rcv.earth Party.fctr.RFE.X..rcv.earth.prob
## 285                            D                        0.3665871
## 1126                           D                        0.5743118
## 1289                           D                        0.5497041
## 1483                           D                        0.4651873
## 1515                           R                        0.6739573
## 1869                           D                        0.5861760
##      Party.fctr.RFE.X..rcv.earth.is.acc Party.fctr.RFE.X..rcv.earth.err
## 285                               FALSE                            TRUE
## 1126                              FALSE                            TRUE
## 1289                              FALSE                            TRUE
## 1483                              FALSE                            TRUE
## 1515                               TRUE                           FALSE
## 1869                               TRUE                           FALSE
##      Party.fctr.RFE.X..rcv.earth.err.abs Party.fctr.RFE.X..rcv.glm
## 285                            0.6334129                         D
## 1126                           0.4256882                         D
## 1289                           0.4502959                         D
## 1483                           0.5348127                         D
## 1515                           0.3260427                         D
## 1869                           0.5861760                         D
##      Party.fctr.RFE.X..rcv.glm.prob Party.fctr.RFE.X..rcv.glm.is.acc
## 285                       0.4500397                            FALSE
## 1126                      0.5172548                            FALSE
## 1289                      0.5442998                            FALSE
## 1483                      0.4845031                            FALSE
## 1515                      0.4523100                            FALSE
## 1869                      0.4674102                             TRUE
##      Party.fctr.RFE.X..rcv.glm.err Party.fctr.RFE.X..rcv.glm.err.abs
## 285                           TRUE                         0.5499603
## 1126                          TRUE                         0.4827452
## 1289                          TRUE                         0.4557002
## 1483                          TRUE                         0.5154969
## 1515                          TRUE                         0.5476900
## 1869                         FALSE                         0.4674102
##      Party.fctr.All.X..rcv.glm Party.fctr.All.X..rcv.glm.prob
## 285                          D                      0.5046418
## 1126                         D                      0.5164835
## 1289                         D                      0.5412691
## 1483                         D                      0.4771148
## 1515                         D                      0.4484790
## 1869                         D                      0.4673232
##      Party.fctr.All.X..rcv.glm.is.acc Party.fctr.All.X..rcv.glm.err
## 285                             FALSE                          TRUE
## 1126                            FALSE                          TRUE
## 1289                            FALSE                          TRUE
## 1483                            FALSE                          TRUE
## 1515                            FALSE                          TRUE
## 1869                             TRUE                         FALSE
##      Party.fctr.All.X..rcv.glm.err.abs Party.fctr.RFE.X..rcv.rf
## 285                          0.4953582                        D
## 1126                         0.4835165                        R
## 1289                         0.4587309                        R
## 1483                         0.5228852                        R
## 1515                         0.5515210                        D
## 1869                         0.4673232                        D
##      Party.fctr.RFE.X..rcv.rf.prob Party.fctr.RFE.X..rcv.rf.is.acc
## 285                          0.358                           FALSE
## 1126                         0.770                            TRUE
## 1289                         0.854                            TRUE
## 1483                         0.852                            TRUE
## 1515                         0.504                           FALSE
## 1869                         0.228                            TRUE
##      Party.fctr.RFE.X..rcv.rf.err Party.fctr.RFE.X..rcv.rf.err.abs
## 285                          TRUE                            0.642
## 1126                        FALSE                            0.230
## 1289                        FALSE                            0.146
## 1483                        FALSE                            0.148
## 1515                         TRUE                            0.496
## 1869                        FALSE                            0.228
##      Party.fctr.RFE.X..rcv.avNNet Party.fctr.RFE.X..rcv.avNNet.prob
## 285                             D                         0.1091323
## 1126                            R                         0.7320856
## 1289                            R                         0.8116179
## 1483                            R                         0.8359264
## 1515                            R                         0.6747115
## 1869                            D                         0.4213566
##      Party.fctr.RFE.X..rcv.avNNet.is.acc Party.fctr.RFE.X..rcv.avNNet.err
## 285                                FALSE                             TRUE
## 1126                                TRUE                            FALSE
## 1289                                TRUE                            FALSE
## 1483                                TRUE                            FALSE
## 1515                                TRUE                            FALSE
## 1869                                TRUE                            FALSE
##      Party.fctr.RFE.X..rcv.avNNet.err.abs Party.fctr.RFE.X..rcv.nnet
## 285                             0.8908677                          D
## 1126                            0.2679144                          D
## 1289                            0.1883821                          R
## 1483                            0.1640736                          R
## 1515                            0.3252885                          D
## 1869                            0.4213566                          D
##      Party.fctr.RFE.X..rcv.nnet.prob Party.fctr.RFE.X..rcv.nnet.is.acc
## 285                        0.6227116                             FALSE
## 1126                       0.6145448                             FALSE
## 1289                       0.7256292                              TRUE
## 1483                       0.6596966                              TRUE
## 1515                       0.6225383                             FALSE
## 1869                       0.3047615                              TRUE
##      Party.fctr.RFE.X..rcv.nnet.err Party.fctr.RFE.X..rcv.nnet.err.abs
## 285                            TRUE                          0.3772884
## 1126                           TRUE                          0.3854552
## 1289                          FALSE                          0.2743708
## 1483                          FALSE                          0.3403034
## 1515                           TRUE                          0.3774617
## 1869                          FALSE                          0.3047615
##      Party.fctr.RFE.X.ica.rcv.glmnet Party.fctr.RFE.X.ica.rcv.glmnet.prob
## 285                                D                            0.4199514
## 1126                               D                            0.4858164
## 1289                               D                            0.4762561
## 1483                               D                            0.4238043
## 1515                               D                            0.4488557
## 1869                               D                            0.4519719
##      Party.fctr.RFE.X.ica.rcv.glmnet.is.acc
## 285                                   FALSE
## 1126                                  FALSE
## 1289                                  FALSE
## 1483                                  FALSE
## 1515                                  FALSE
## 1869                                   TRUE
##      Party.fctr.RFE.X.ica.rcv.glmnet.err
## 285                                 TRUE
## 1126                                TRUE
## 1289                                TRUE
## 1483                                TRUE
## 1515                                TRUE
## 1869                               FALSE
##      Party.fctr.RFE.X.ica.rcv.glmnet.err.abs
## 285                                0.5800486
## 1126                               0.5141836
## 1289                               0.5237439
## 1483                               0.5761957
## 1515                               0.5511443
## 1869                               0.4519719
##      Party.fctr.All.X.ica.rcv.glmnet Party.fctr.All.X.ica.rcv.glmnet.prob
## 285                                D                            0.4166863
## 1126                               D                            0.4848066
## 1289                               D                            0.4812095
## 1483                               D                            0.4304445
## 1515                               D                            0.4417073
## 1869                               D                            0.4501259
##      Party.fctr.All.X.ica.rcv.glmnet.is.acc
## 285                                   FALSE
## 1126                                  FALSE
## 1289                                  FALSE
## 1483                                  FALSE
## 1515                                  FALSE
## 1869                                   TRUE
##      Party.fctr.All.X.ica.rcv.glmnet.err
## 285                                 TRUE
## 1126                                TRUE
## 1289                                TRUE
## 1483                                TRUE
## 1515                                TRUE
## 1869                               FALSE
##      Party.fctr.All.X.ica.rcv.glmnet.err.abs
## 285                                0.5833137
## 1126                               0.5151934
## 1289                               0.5187905
## 1483                               0.5695555
## 1515                               0.5582927
## 1869                               0.4501259
##      Party.fctr.Interact.High.cor.Y..rcv.glmnet
## 285                                           D
## 1126                                          D
## 1289                                          D
## 1483                                          D
## 1515                                          D
## 1869                                          D
##      Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## 285                                        0.4103951
## 1126                                       0.5115123
## 1289                                       0.4674913
## 1483                                       0.5801181
## 1515                                       0.5152728
## 1869                                       0.6335740
##      Party.fctr.Interact.High.cor.Y..rcv.glmnet.is.acc
## 285                                              FALSE
## 1126                                             FALSE
## 1289                                             FALSE
## 1483                                             FALSE
## 1515                                             FALSE
## 1869                                              TRUE
##      Party.fctr.Interact.High.cor.Y..rcv.glmnet.err
## 285                                            TRUE
## 1126                                           TRUE
## 1289                                           TRUE
## 1483                                           TRUE
## 1515                                           TRUE
## 1869                                          FALSE
##      Party.fctr.Interact.High.cor.Y..rcv.glmnet.err.abs
## 285                                           0.5896049
## 1126                                          0.4884877
## 1289                                          0.5325087
## 1483                                          0.4198819
## 1515                                          0.4847272
## 1869                                          0.6335740
##      Party.fctr.Ensemble.auto.2..rcv.glmnet.prob
## 285                                           NA
## 1126                                   0.5518203
## 1289                                   0.5196494
## 1483                                   0.6119311
## 1515                                          NA
## 1869                                   0.5924222
##      Party.fctr.Ensemble.auto.2..rcv.glmnet
## 285                                    <NA>
## 1126                                      D
## 1289                                      D
## 1483                                      D
## 1515                                   <NA>
## 1869                                      D
##      Party.fctr.Ensemble.auto.2..rcv.glmnet.err
## 285                                          NA
## 1126                                       TRUE
## 1289                                       TRUE
## 1483                                       TRUE
## 1515                                         NA
## 1869                                      FALSE
##      Party.fctr.Ensemble.auto.2..rcv.glmnet.err.abs
## 285                                              NA
## 1126                                      0.4481797
## 1289                                      0.4803506
## 1483                                      0.3880689
## 1515                                             NA
## 1869                                      0.5924222
##      Party.fctr.Ensemble.auto.2..rcv.glmnet.is.acc
## 285                                             NA
## 1126                                         FALSE
## 1289                                         FALSE
## 1483                                         FALSE
## 1515                                            NA
## 1869                                          TRUE
##      Party.fctr.Final.RFE.X.Inc..rcv.bagEarth.prob
## 285                                      0.3592399
## 1126                                     0.5153332
## 1289                                     0.5337344
## 1483                                     0.5547348
## 1515                                     0.5627490
## 1869                                     0.6369772
##      Party.fctr.Final.RFE.X.Inc..rcv.bagEarth
## 285                                         D
## 1126                                        D
## 1289                                        D
## 1483                                        D
## 1515                                        D
## 1869                                        D
##      Party.fctr.Final.RFE.X.Inc..rcv.bagEarth.err
## 285                                          TRUE
## 1126                                         TRUE
## 1289                                         TRUE
## 1483                                         TRUE
## 1515                                         TRUE
## 1869                                        FALSE
##      Party.fctr.Final.RFE.X.Inc..rcv.bagEarth.err.abs
## 285                                         0.6407601
## 1126                                        0.4846668
## 1289                                        0.4662656
## 1483                                        0.4452652
## 1515                                        0.4372510
## 1869                                        0.6369772
##      Party.fctr.Final.RFE.X.Inc..rcv.bagEarth.is.acc
## 285                                            FALSE
## 1126                                           FALSE
## 1289                                           FALSE
## 1483                                           FALSE
## 1515                                           FALSE
## 1869                                            TRUE
##      Party.fctr.Final.All.X.ica.rcv.glmnet.prob
## 285                                   0.4166863
## 1126                                  0.4848066
## 1289                                  0.4812095
## 1483                                  0.4304445
## 1515                                  0.4417073
## 1869                                  0.4501259
##      Party.fctr.Final.All.X.ica.rcv.glmnet
## 285                                      D
## 1126                                     D
## 1289                                     D
## 1483                                     D
## 1515                                     D
## 1869                                     D
##      Party.fctr.Final.All.X.ica.rcv.glmnet.err
## 285                                       TRUE
## 1126                                      TRUE
## 1289                                      TRUE
## 1483                                      TRUE
## 1515                                      TRUE
## 1869                                     FALSE
##      Party.fctr.Final.All.X.ica.rcv.glmnet.err.abs
## 285                                      0.5833137
## 1126                                     0.5151934
## 1289                                     0.5187905
## 1483                                     0.5695555
## 1515                                     0.5582927
## 1869                                     0.4501259
##      Party.fctr.Final.All.X.ica.rcv.glmnet.is.acc
## 285                                         FALSE
## 1126                                        FALSE
## 1289                                        FALSE
## 1483                                        FALSE
## 1515                                        FALSE
## 1869                                         TRUE
##      Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.prob
## 285                                          0.3176454
## 1126                                         0.5127033
## 1289                                         0.5382058
## 1483                                         0.5731279
## 1515                                         0.5823363
## 1869                                         0.6754331
##      Party.fctr.Final.Ensemble.auto.2..rcv.glmnet
## 285                                             D
## 1126                                            D
## 1289                                            D
## 1483                                            D
## 1515                                            D
## 1869                                            R
##      Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.err
## 285                                              TRUE
## 1126                                             TRUE
## 1289                                             TRUE
## 1483                                             TRUE
## 1515                                             TRUE
## 1869                                             TRUE
##      Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.err.abs
## 285                                             0.6823546
## 1126                                            0.4872967
## 1289                                            0.4617942
## 1483                                            0.4268721
## 1515                                            0.4176637
## 1869                                            0.6754331
##      Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.is.acc
## 285                                                FALSE
## 1126                                               FALSE
## 1289                                               FALSE
## 1483                                               FALSE
## 1515                                               FALSE
## 1869                                               FALSE
##      Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.accurate
## 285                                                  FALSE
## 1126                                                 FALSE
## 1289                                                 FALSE
## 1483                                                 FALSE
## 1515                                                 FALSE
## 1869                                                 FALSE
##      Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.error
## 285                                         -0.33235458
## 1126                                        -0.13729672
## 1289                                        -0.11179415
## 1483                                        -0.07687212
## 1515                                        -0.06766374
## 1869                                         0.02543308
##      USER_ID Party.fctr Party.fctr.RFE.X.Inc..rcv.bagEarth
## 2091    1393          D                                  R
## 2092    1311          D                                  R
## 2093    1309          D                                  R
## 2094     892          D                                  R
## 2095    2641          D                                  R
## 2096    3006          D                                  R
##      Party.fctr.RFE.X.Inc..rcv.bagEarth.prob
## 2091                               0.8366347
## 2092                               0.8362552
## 2093                               0.8384290
## 2094                               0.8350554
## 2095                               0.8394247
## 2096                               0.8442049
##      Party.fctr.RFE.X.Inc..rcv.bagEarth.is.acc
## 2091                                     FALSE
## 2092                                     FALSE
## 2093                                     FALSE
## 2094                                     FALSE
## 2095                                     FALSE
## 2096                                     FALSE
##      Party.fctr.RFE.X.Inc..rcv.bagEarth.err
## 2091                                   TRUE
## 2092                                   TRUE
## 2093                                   TRUE
## 2094                                   TRUE
## 2095                                   TRUE
## 2096                                   TRUE
##      Party.fctr.RFE.X.Inc..rcv.bagEarth.err.abs
## 2091                                  0.8366347
## 2092                                  0.8362552
## 2093                                  0.8384290
## 2094                                  0.8350554
## 2095                                  0.8394247
## 2096                                  0.8442049
##      Party.fctr.RFE.X..rcv.bagEarth Party.fctr.RFE.X..rcv.bagEarth.prob
## 2091                              R                           0.8333936
## 2092                              R                           0.8330639
## 2093                              R                           0.8456653
## 2094                              R                           0.8419323
## 2095                              R                           0.8502812
## 2096                              R                           0.8955813
##      Party.fctr.RFE.X..rcv.bagEarth.is.acc
## 2091                                 FALSE
## 2092                                 FALSE
## 2093                                 FALSE
## 2094                                 FALSE
## 2095                                 FALSE
## 2096                                 FALSE
##      Party.fctr.RFE.X..rcv.bagEarth.err
## 2091                               TRUE
## 2092                               TRUE
## 2093                               TRUE
## 2094                               TRUE
## 2095                               TRUE
## 2096                               TRUE
##      Party.fctr.RFE.X..rcv.bagEarth.err.abs
## 2091                              0.8333936
## 2092                              0.8330639
## 2093                              0.8456653
## 2094                              0.8419323
## 2095                              0.8502812
## 2096                              0.8955813
##      Party.fctr.RFE.X.zv.pca.rcv.glmnet
## 2091                                  R
## 2092                                  R
## 2093                                  R
## 2094                                  R
## 2095                                  R
## 2096                                  R
##      Party.fctr.RFE.X.zv.pca.rcv.glmnet.prob
## 2091                               0.6708123
## 2092                               0.7768953
## 2093                               0.8106673
## 2094                               0.8034368
## 2095                               0.8177903
## 2096                               0.7871980
##      Party.fctr.RFE.X.zv.pca.rcv.glmnet.is.acc
## 2091                                     FALSE
## 2092                                     FALSE
## 2093                                     FALSE
## 2094                                     FALSE
## 2095                                     FALSE
## 2096                                     FALSE
##      Party.fctr.RFE.X.zv.pca.rcv.glmnet.err
## 2091                                   TRUE
## 2092                                   TRUE
## 2093                                   TRUE
## 2094                                   TRUE
## 2095                                   TRUE
## 2096                                   TRUE
##      Party.fctr.RFE.X.zv.pca.rcv.glmnet.err.abs
## 2091                                  0.6708123
## 2092                                  0.7768953
## 2093                                  0.8106673
## 2094                                  0.8034368
## 2095                                  0.8177903
## 2096                                  0.7871980
##      Party.fctr.All.X.nzv.spatialSign.rcv.glmnet
## 2091                                           R
## 2092                                           R
## 2093                                           R
## 2094                                           R
## 2095                                           R
## 2096                                           R
##      Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.prob
## 2091                                        0.7561127
## 2092                                        0.7607013
## 2093                                        0.7881526
## 2094                                        0.7444508
## 2095                                        0.7788211
## 2096                                        0.7762167
##      Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.is.acc
## 2091                                              FALSE
## 2092                                              FALSE
## 2093                                              FALSE
## 2094                                              FALSE
## 2095                                              FALSE
## 2096                                              FALSE
##      Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.err
## 2091                                            TRUE
## 2092                                            TRUE
## 2093                                            TRUE
## 2094                                            TRUE
## 2095                                            TRUE
## 2096                                            TRUE
##      Party.fctr.All.X.nzv.spatialSign.rcv.glmnet.err.abs
## 2091                                           0.7561127
## 2092                                           0.7607013
## 2093                                           0.7881526
## 2094                                           0.7444508
## 2095                                           0.7788211
## 2096                                           0.7762167
##      Party.fctr.All.X.spatialSign.rcv.glmnet
## 2091                                       R
## 2092                                       R
## 2093                                       R
## 2094                                       R
## 2095                                       R
## 2096                                       R
##      Party.fctr.All.X.spatialSign.rcv.glmnet.prob
## 2091                                    0.7638163
## 2092                                    0.7624399
## 2093                                    0.7877210
## 2094                                    0.7547337
## 2095                                    0.7507421
## 2096                                    0.7661737
##      Party.fctr.All.X.spatialSign.rcv.glmnet.is.acc
## 2091                                          FALSE
## 2092                                          FALSE
## 2093                                          FALSE
## 2094                                          FALSE
## 2095                                          FALSE
## 2096                                          FALSE
##      Party.fctr.All.X.spatialSign.rcv.glmnet.err
## 2091                                        TRUE
## 2092                                        TRUE
## 2093                                        TRUE
## 2094                                        TRUE
## 2095                                        TRUE
## 2096                                        TRUE
##      Party.fctr.All.X.spatialSign.rcv.glmnet.err.abs
## 2091                                       0.7638163
## 2092                                       0.7624399
## 2093                                       0.7877210
## 2094                                       0.7547337
## 2095                                       0.7507421
## 2096                                       0.7661737
##      Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet
## 2091                                           R
## 2092                                           R
## 2093                                           R
## 2094                                           R
## 2095                                           R
## 2096                                           R
##      Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.prob
## 2091                                        0.7564985
## 2092                                        0.7597932
## 2093                                        0.7876670
## 2094                                        0.7445485
## 2095                                        0.7789910
## 2096                                        0.7761224
##      Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.is.acc
## 2091                                              FALSE
## 2092                                              FALSE
## 2093                                              FALSE
## 2094                                              FALSE
## 2095                                              FALSE
## 2096                                              FALSE
##      Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.err
## 2091                                            TRUE
## 2092                                            TRUE
## 2093                                            TRUE
## 2094                                            TRUE
## 2095                                            TRUE
## 2096                                            TRUE
##      Party.fctr.RFE.X.nzv.spatialSign.rcv.glmnet.err.abs
## 2091                                           0.7564985
## 2092                                           0.7597932
## 2093                                           0.7876670
## 2094                                           0.7445485
## 2095                                           0.7789910
## 2096                                           0.7761224
##      Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet
## 2091                                               R
## 2092                                               R
## 2093                                               R
## 2094                                               R
## 2095                                               R
## 2096                                               R
##      Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.prob
## 2091                                            0.7865578
## 2092                                            0.7890893
## 2093                                            0.8168050
## 2094                                            0.7604862
## 2095                                            0.7947198
## 2096                                            0.7897290
##      Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.is.acc
## 2091                                                  FALSE
## 2092                                                  FALSE
## 2093                                                  FALSE
## 2094                                                  FALSE
## 2095                                                  FALSE
## 2096                                                  FALSE
##      Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.err
## 2091                                                TRUE
## 2092                                                TRUE
## 2093                                                TRUE
## 2094                                                TRUE
## 2095                                                TRUE
## 2096                                                TRUE
##      Party.fctr.All.X.Inc.nzv.spatialSign.rcv.glmnet.err.abs
## 2091                                               0.7865578
## 2092                                               0.7890893
## 2093                                               0.8168050
## 2094                                               0.7604862
## 2095                                               0.7947198
## 2096                                               0.7897290
##      Party.fctr.RFE.X.spatialSign.rcv.glmnet
## 2091                                       R
## 2092                                       R
## 2093                                       R
## 2094                                       R
## 2095                                       R
## 2096                                       R
##      Party.fctr.RFE.X.spatialSign.rcv.glmnet.prob
## 2091                                    0.7639475
## 2092                                    0.7614147
## 2093                                    0.7871647
## 2094                                    0.7539711
## 2095                                    0.7499441
## 2096                                    0.7723208
##      Party.fctr.RFE.X.spatialSign.rcv.glmnet.is.acc
## 2091                                          FALSE
## 2092                                          FALSE
## 2093                                          FALSE
## 2094                                          FALSE
## 2095                                          FALSE
## 2096                                          FALSE
##      Party.fctr.RFE.X.spatialSign.rcv.glmnet.err
## 2091                                        TRUE
## 2092                                        TRUE
## 2093                                        TRUE
## 2094                                        TRUE
## 2095                                        TRUE
## 2096                                        TRUE
##      Party.fctr.RFE.X.spatialSign.rcv.glmnet.err.abs
## 2091                                       0.7639475
## 2092                                       0.7614147
## 2093                                       0.7871647
## 2094                                       0.7539711
## 2095                                       0.7499441
## 2096                                       0.7723208
##      Party.fctr.All.X.nzv.rcv.glmnet Party.fctr.All.X.nzv.rcv.glmnet.prob
## 2091                               R                            0.7624790
## 2092                               R                            0.7511503
## 2093                               R                            0.8003803
## 2094                               R                            0.7582014
## 2095                               R                            0.7765515
## 2096                               R                            0.7959818
##      Party.fctr.All.X.nzv.rcv.glmnet.is.acc
## 2091                                  FALSE
## 2092                                  FALSE
## 2093                                  FALSE
## 2094                                  FALSE
## 2095                                  FALSE
## 2096                                  FALSE
##      Party.fctr.All.X.nzv.rcv.glmnet.err
## 2091                                TRUE
## 2092                                TRUE
## 2093                                TRUE
## 2094                                TRUE
## 2095                                TRUE
## 2096                                TRUE
##      Party.fctr.All.X.nzv.rcv.glmnet.err.abs
## 2091                               0.7624790
## 2092                               0.7511503
## 2093                               0.8003803
## 2094                               0.7582014
## 2095                               0.7765515
## 2096                               0.7959818
##      Party.fctr.RFE.X.nzv.rcv.glmnet Party.fctr.RFE.X.nzv.rcv.glmnet.prob
## 2091                               R                            0.7632306
## 2092                               R                            0.7519050
## 2093                               R                            0.8006129
## 2094                               R                            0.7597933
## 2095                               R                            0.7773654
## 2096                               R                            0.7918549
##      Party.fctr.RFE.X.nzv.rcv.glmnet.is.acc
## 2091                                  FALSE
## 2092                                  FALSE
## 2093                                  FALSE
## 2094                                  FALSE
## 2095                                  FALSE
## 2096                                  FALSE
##      Party.fctr.RFE.X.nzv.rcv.glmnet.err
## 2091                                TRUE
## 2092                                TRUE
## 2093                                TRUE
## 2094                                TRUE
## 2095                                TRUE
## 2096                                TRUE
##      Party.fctr.RFE.X.nzv.rcv.glmnet.err.abs
## 2091                               0.7632306
## 2092                               0.7519050
## 2093                               0.8006129
## 2094                               0.7597933
## 2095                               0.7773654
## 2096                               0.7918549
##      Party.fctr.All.X.expoTrans.rcv.glmnet
## 2091                                     R
## 2092                                     R
## 2093                                     R
## 2094                                     R
## 2095                                     R
## 2096                                     R
##      Party.fctr.All.X.expoTrans.rcv.glmnet.prob
## 2091                                  0.7625744
## 2092                                  0.7450704
## 2093                                  0.7921285
## 2094                                  0.7645389
## 2095                                  0.7474150
## 2096                                  0.7827551
##      Party.fctr.All.X.expoTrans.rcv.glmnet.is.acc
## 2091                                        FALSE
## 2092                                        FALSE
## 2093                                        FALSE
## 2094                                        FALSE
## 2095                                        FALSE
## 2096                                        FALSE
##      Party.fctr.All.X.expoTrans.rcv.glmnet.err
## 2091                                      TRUE
## 2092                                      TRUE
## 2093                                      TRUE
## 2094                                      TRUE
## 2095                                      TRUE
## 2096                                      TRUE
##      Party.fctr.All.X.expoTrans.rcv.glmnet.err.abs
## 2091                                     0.7625744
## 2092                                     0.7450704
## 2093                                     0.7921285
## 2094                                     0.7645389
## 2095                                     0.7474150
## 2096                                     0.7827551
##      Party.fctr.RFE.X.expoTrans.rcv.glmnet
## 2091                                     R
## 2092                                     R
## 2093                                     R
## 2094                                     R
## 2095                                     R
## 2096                                     R
##      Party.fctr.RFE.X.expoTrans.rcv.glmnet.prob
## 2091                                  0.7625744
## 2092                                  0.7450704
## 2093                                  0.7921285
## 2094                                  0.7645389
## 2095                                  0.7474150
## 2096                                  0.7827551
##      Party.fctr.RFE.X.expoTrans.rcv.glmnet.is.acc
## 2091                                        FALSE
## 2092                                        FALSE
## 2093                                        FALSE
## 2094                                        FALSE
## 2095                                        FALSE
## 2096                                        FALSE
##      Party.fctr.RFE.X.expoTrans.rcv.glmnet.err
## 2091                                      TRUE
## 2092                                      TRUE
## 2093                                      TRUE
## 2094                                      TRUE
## 2095                                      TRUE
## 2096                                      TRUE
##      Party.fctr.RFE.X.expoTrans.rcv.glmnet.err.abs
## 2091                                     0.7625744
## 2092                                     0.7450704
## 2093                                     0.7921285
## 2094                                     0.7645389
## 2095                                     0.7474150
## 2096                                     0.7827551
##      Party.fctr.All.X.YeoJohnson.rcv.glmnet
## 2091                                      R
## 2092                                      R
## 2093                                      R
## 2094                                      R
## 2095                                      R
## 2096                                      R
##      Party.fctr.All.X.YeoJohnson.rcv.glmnet.prob
## 2091                                   0.7625311
## 2092                                   0.7451657
## 2093                                   0.7921805
## 2094                                   0.7646698
## 2095                                   0.7475486
## 2096                                   0.7827597
##      Party.fctr.All.X.YeoJohnson.rcv.glmnet.is.acc
## 2091                                         FALSE
## 2092                                         FALSE
## 2093                                         FALSE
## 2094                                         FALSE
## 2095                                         FALSE
## 2096                                         FALSE
##      Party.fctr.All.X.YeoJohnson.rcv.glmnet.err
## 2091                                       TRUE
## 2092                                       TRUE
## 2093                                       TRUE
## 2094                                       TRUE
## 2095                                       TRUE
## 2096                                       TRUE
##      Party.fctr.All.X.YeoJohnson.rcv.glmnet.err.abs
## 2091                                      0.7625311
## 2092                                      0.7451657
## 2093                                      0.7921805
## 2094                                      0.7646698
## 2095                                      0.7475486
## 2096                                      0.7827597
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet
## 2091                                      R
## 2092                                      R
## 2093                                      R
## 2094                                      R
## 2095                                      R
## 2096                                      R
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.prob
## 2091                                   0.7625311
## 2092                                   0.7451657
## 2093                                   0.7921805
## 2094                                   0.7646698
## 2095                                   0.7475486
## 2096                                   0.7827597
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.is.acc
## 2091                                         FALSE
## 2092                                         FALSE
## 2093                                         FALSE
## 2094                                         FALSE
## 2095                                         FALSE
## 2096                                         FALSE
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.err
## 2091                                       TRUE
## 2092                                       TRUE
## 2093                                       TRUE
## 2094                                       TRUE
## 2095                                       TRUE
## 2096                                       TRUE
##      Party.fctr.RFE.X.YeoJohnson.rcv.glmnet.err.abs
## 2091                                      0.7625311
## 2092                                      0.7451657
## 2093                                      0.7921805
## 2094                                      0.7646698
## 2095                                      0.7475486
## 2096                                      0.7827597
##      Party.fctr.RFE.X..rcv.rpart Party.fctr.RFE.X..rcv.rpart.prob
## 2091                           R                        0.6666667
## 2092                           R                        0.6666667
## 2093                           R                        0.6666667
## 2094                           R                        0.6666667
## 2095                           R                        0.6666667
## 2096                           R                        0.6666667
##      Party.fctr.RFE.X..rcv.rpart.is.acc Party.fctr.RFE.X..rcv.rpart.err
## 2091                              FALSE                            TRUE
## 2092                              FALSE                            TRUE
## 2093                              FALSE                            TRUE
## 2094                              FALSE                            TRUE
## 2095                              FALSE                            TRUE
## 2096                              FALSE                            TRUE
##      Party.fctr.RFE.X..rcv.rpart.err.abs Party.fctr.RFE.X..rcv.glmnet
## 2091                           0.6666667                            R
## 2092                           0.6666667                            R
## 2093                           0.6666667                            R
## 2094                           0.6666667                            R
## 2095                           0.6666667                            R
## 2096                           0.6666667                            R
##      Party.fctr.RFE.X..rcv.glmnet.prob Party.fctr.RFE.X..rcv.glmnet.is.acc
## 2091                         0.7621309                               FALSE
## 2092                         0.7456295                               FALSE
## 2093                         0.7929111                               FALSE
## 2094                         0.7639110                               FALSE
## 2095                         0.7486126                               FALSE
## 2096                         0.7821974                               FALSE
##      Party.fctr.RFE.X..rcv.glmnet.err Party.fctr.RFE.X..rcv.glmnet.err.abs
## 2091                             TRUE                            0.7621309
## 2092                             TRUE                            0.7456295
## 2093                             TRUE                            0.7929111
## 2094                             TRUE                            0.7639110
## 2095                             TRUE                            0.7486126
## 2096                             TRUE                            0.7821974
##      Party.fctr.All.X.conditionalX.rcv.glmnet
## 2091                                        R
## 2092                                        R
## 2093                                        R
## 2094                                        R
## 2095                                        R
## 2096                                        R
##      Party.fctr.All.X.conditionalX.rcv.glmnet.prob
## 2091                                     0.7621309
## 2092                                     0.7456295
## 2093                                     0.7929111
## 2094                                     0.7639110
## 2095                                     0.7486126
## 2096                                     0.7821974
##      Party.fctr.All.X.conditionalX.rcv.glmnet.is.acc
## 2091                                           FALSE
## 2092                                           FALSE
## 2093                                           FALSE
## 2094                                           FALSE
## 2095                                           FALSE
## 2096                                           FALSE
##      Party.fctr.All.X.conditionalX.rcv.glmnet.err
## 2091                                         TRUE
## 2092                                         TRUE
## 2093                                         TRUE
## 2094                                         TRUE
## 2095                                         TRUE
## 2096                                         TRUE
##      Party.fctr.All.X.conditionalX.rcv.glmnet.err.abs
## 2091                                        0.7621309
## 2092                                        0.7456295
## 2093                                        0.7929111
## 2094                                        0.7639110
## 2095                                        0.7486126
## 2096                                        0.7821974
##      Party.fctr.All.X..rcv.glmnet Party.fctr.All.X..rcv.glmnet.prob
## 2091                            R                         0.7621309
## 2092                            R                         0.7456295
## 2093                            R                         0.7929111
## 2094                            R                         0.7639110
## 2095                            R                         0.7486126
## 2096                            R                         0.7821974
##      Party.fctr.All.X..rcv.glmnet.is.acc Party.fctr.All.X..rcv.glmnet.err
## 2091                               FALSE                             TRUE
## 2092                               FALSE                             TRUE
## 2093                               FALSE                             TRUE
## 2094                               FALSE                             TRUE
## 2095                               FALSE                             TRUE
## 2096                               FALSE                             TRUE
##      Party.fctr.All.X..rcv.glmnet.err.abs Party.fctr.Low.cor.X..rcv.glmnet
## 2091                            0.7621309                                R
## 2092                            0.7456295                                R
## 2093                            0.7929111                                R
## 2094                            0.7639110                                R
## 2095                            0.7486126                                R
## 2096                            0.7821974                                R
##      Party.fctr.Low.cor.X..rcv.glmnet.prob
## 2091                             0.7621309
## 2092                             0.7456295
## 2093                             0.7929111
## 2094                             0.7639110
## 2095                             0.7486126
## 2096                             0.7821974
##      Party.fctr.Low.cor.X..rcv.glmnet.is.acc
## 2091                                   FALSE
## 2092                                   FALSE
## 2093                                   FALSE
## 2094                                   FALSE
## 2095                                   FALSE
## 2096                                   FALSE
##      Party.fctr.Low.cor.X..rcv.glmnet.err
## 2091                                 TRUE
## 2092                                 TRUE
## 2093                                 TRUE
## 2094                                 TRUE
## 2095                                 TRUE
## 2096                                 TRUE
##      Party.fctr.Low.cor.X..rcv.glmnet.err.abs
## 2091                                0.7621309
## 2092                                0.7456295
## 2093                                0.7929111
## 2094                                0.7639110
## 2095                                0.7486126
## 2096                                0.7821974
##      Party.fctr.RFE.X.conditionalX.rcv.glmnet
## 2091                                        R
## 2092                                        R
## 2093                                        R
## 2094                                        R
## 2095                                        R
## 2096                                        R
##      Party.fctr.RFE.X.conditionalX.rcv.glmnet.prob
## 2091                                     0.7621309
## 2092                                     0.7456295
## 2093                                     0.7929111
## 2094                                     0.7639110
## 2095                                     0.7486126
## 2096                                     0.7821974
##      Party.fctr.RFE.X.conditionalX.rcv.glmnet.is.acc
## 2091                                           FALSE
## 2092                                           FALSE
## 2093                                           FALSE
## 2094                                           FALSE
## 2095                                           FALSE
## 2096                                           FALSE
##      Party.fctr.RFE.X.conditionalX.rcv.glmnet.err
## 2091                                         TRUE
## 2092                                         TRUE
## 2093                                         TRUE
## 2094                                         TRUE
## 2095                                         TRUE
## 2096                                         TRUE
##      Party.fctr.RFE.X.conditionalX.rcv.glmnet.err.abs
## 2091                                        0.7621309
## 2092                                        0.7456295
## 2093                                        0.7929111
## 2094                                        0.7639110
## 2095                                        0.7486126
## 2096                                        0.7821974
##      Party.fctr.All.X.zv.rcv.glmnet Party.fctr.All.X.zv.rcv.glmnet.prob
## 2091                              R                           0.7621309
## 2092                              R                           0.7456295
## 2093                              R                           0.7929111
## 2094                              R                           0.7639110
## 2095                              R                           0.7486126
## 2096                              R                           0.7821974
##      Party.fctr.All.X.zv.rcv.glmnet.is.acc
## 2091                                 FALSE
## 2092                                 FALSE
## 2093                                 FALSE
## 2094                                 FALSE
## 2095                                 FALSE
## 2096                                 FALSE
##      Party.fctr.All.X.zv.rcv.glmnet.err
## 2091                               TRUE
## 2092                               TRUE
## 2093                               TRUE
## 2094                               TRUE
## 2095                               TRUE
## 2096                               TRUE
##      Party.fctr.All.X.zv.rcv.glmnet.err.abs Party.fctr.RFE.X.zv.rcv.glmnet
## 2091                              0.7621309                              R
## 2092                              0.7456295                              R
## 2093                              0.7929111                              R
## 2094                              0.7639110                              R
## 2095                              0.7486126                              R
## 2096                              0.7821974                              R
##      Party.fctr.RFE.X.zv.rcv.glmnet.prob
## 2091                           0.7621309
## 2092                           0.7456295
## 2093                           0.7929111
## 2094                           0.7639110
## 2095                           0.7486126
## 2096                           0.7821974
##      Party.fctr.RFE.X.zv.rcv.glmnet.is.acc
## 2091                                 FALSE
## 2092                                 FALSE
## 2093                                 FALSE
## 2094                                 FALSE
## 2095                                 FALSE
## 2096                                 FALSE
##      Party.fctr.RFE.X.zv.rcv.glmnet.err
## 2091                               TRUE
## 2092                               TRUE
## 2093                               TRUE
## 2094                               TRUE
## 2095                               TRUE
## 2096                               TRUE
##      Party.fctr.RFE.X.zv.rcv.glmnet.err.abs
## 2091                              0.7621309
## 2092                              0.7456295
## 2093                              0.7929111
## 2094                              0.7639110
## 2095                              0.7486126
## 2096                              0.7821974
##      Party.fctr.RFE.X.scale.rcv.glmnet
## 2091                                 R
## 2092                                 R
## 2093                                 R
## 2094                                 R
## 2095                                 R
## 2096                                 R
##      Party.fctr.RFE.X.scale.rcv.glmnet.prob
## 2091                              0.7621309
## 2092                              0.7456295
## 2093                              0.7929111
## 2094                              0.7639110
## 2095                              0.7486126
## 2096                              0.7821974
##      Party.fctr.RFE.X.scale.rcv.glmnet.is.acc
## 2091                                    FALSE
## 2092                                    FALSE
## 2093                                    FALSE
## 2094                                    FALSE
## 2095                                    FALSE
## 2096                                    FALSE
##      Party.fctr.RFE.X.scale.rcv.glmnet.err
## 2091                                  TRUE
## 2092                                  TRUE
## 2093                                  TRUE
## 2094                                  TRUE
## 2095                                  TRUE
## 2096                                  TRUE
##      Party.fctr.RFE.X.scale.rcv.glmnet.err.abs
## 2091                                 0.7621309
## 2092                                 0.7456295
## 2093                                 0.7929111
## 2094                                 0.7639110
## 2095                                 0.7486126
## 2096                                 0.7821974
##      Party.fctr.RFE.X.center.rcv.glmnet
## 2091                                  R
## 2092                                  R
## 2093                                  R
## 2094                                  R
## 2095                                  R
## 2096                                  R
##      Party.fctr.RFE.X.center.rcv.glmnet.prob
## 2091                               0.7621309
## 2092                               0.7456295
## 2093                               0.7929111
## 2094                               0.7639110
## 2095                               0.7486126
## 2096                               0.7821974
##      Party.fctr.RFE.X.center.rcv.glmnet.is.acc
## 2091                                     FALSE
## 2092                                     FALSE
## 2093                                     FALSE
## 2094                                     FALSE
## 2095                                     FALSE
## 2096                                     FALSE
##      Party.fctr.RFE.X.center.rcv.glmnet.err
## 2091                                   TRUE
## 2092                                   TRUE
## 2093                                   TRUE
## 2094                                   TRUE
## 2095                                   TRUE
## 2096                                   TRUE
##      Party.fctr.RFE.X.center.rcv.glmnet.err.abs
## 2091                                  0.7621309
## 2092                                  0.7456295
## 2093                                  0.7929111
## 2094                                  0.7639110
## 2095                                  0.7486126
## 2096                                  0.7821974
##      Party.fctr.All.X.scale.rcv.glmnet
## 2091                                 R
## 2092                                 R
## 2093                                 R
## 2094                                 R
## 2095                                 R
## 2096                                 R
##      Party.fctr.All.X.scale.rcv.glmnet.prob
## 2091                              0.7621309
## 2092                              0.7456295
## 2093                              0.7929111
## 2094                              0.7639110
## 2095                              0.7486126
## 2096                              0.7821974
##      Party.fctr.All.X.scale.rcv.glmnet.is.acc
## 2091                                    FALSE
## 2092                                    FALSE
## 2093                                    FALSE
## 2094                                    FALSE
## 2095                                    FALSE
## 2096                                    FALSE
##      Party.fctr.All.X.scale.rcv.glmnet.err
## 2091                                  TRUE
## 2092                                  TRUE
## 2093                                  TRUE
## 2094                                  TRUE
## 2095                                  TRUE
## 2096                                  TRUE
##      Party.fctr.All.X.scale.rcv.glmnet.err.abs
## 2091                                 0.7621309
## 2092                                 0.7456295
## 2093                                 0.7929111
## 2094                                 0.7639110
## 2095                                 0.7486126
## 2096                                 0.7821974
##      Party.fctr.All.X.center.rcv.glmnet
## 2091                                  R
## 2092                                  R
## 2093                                  R
## 2094                                  R
## 2095                                  R
## 2096                                  R
##      Party.fctr.All.X.center.rcv.glmnet.prob
## 2091                               0.7621309
## 2092                               0.7456295
## 2093                               0.7929111
## 2094                               0.7639110
## 2095                               0.7486126
## 2096                               0.7821974
##      Party.fctr.All.X.center.rcv.glmnet.is.acc
## 2091                                     FALSE
## 2092                                     FALSE
## 2093                                     FALSE
## 2094                                     FALSE
## 2095                                     FALSE
## 2096                                     FALSE
##      Party.fctr.All.X.center.rcv.glmnet.err
## 2091                                   TRUE
## 2092                                   TRUE
## 2093                                   TRUE
## 2094                                   TRUE
## 2095                                   TRUE
## 2096                                   TRUE
##      Party.fctr.All.X.center.rcv.glmnet.err.abs
## 2091                                  0.7621309
## 2092                                  0.7456295
## 2093                                  0.7929111
## 2094                                  0.7639110
## 2095                                  0.7486126
## 2096                                  0.7821974
##      Party.fctr.RFE.X.range.rcv.glmnet
## 2091                                 R
## 2092                                 R
## 2093                                 R
## 2094                                 R
## 2095                                 R
## 2096                                 R
##      Party.fctr.RFE.X.range.rcv.glmnet.prob
## 2091                              0.7621309
## 2092                              0.7456295
## 2093                              0.7929111
## 2094                              0.7639110
## 2095                              0.7486126
## 2096                              0.7821974
##      Party.fctr.RFE.X.range.rcv.glmnet.is.acc
## 2091                                    FALSE
## 2092                                    FALSE
## 2093                                    FALSE
## 2094                                    FALSE
## 2095                                    FALSE
## 2096                                    FALSE
##      Party.fctr.RFE.X.range.rcv.glmnet.err
## 2091                                  TRUE
## 2092                                  TRUE
## 2093                                  TRUE
## 2094                                  TRUE
## 2095                                  TRUE
## 2096                                  TRUE
##      Party.fctr.RFE.X.range.rcv.glmnet.err.abs
## 2091                                 0.7621309
## 2092                                 0.7456295
## 2093                                 0.7929111
## 2094                                 0.7639110
## 2095                                 0.7486126
## 2096                                 0.7821974
##      Party.fctr.RFE.X.BoxCox.rcv.glmnet
## 2091                                  R
## 2092                                  R
## 2093                                  R
## 2094                                  R
## 2095                                  R
## 2096                                  R
##      Party.fctr.RFE.X.BoxCox.rcv.glmnet.prob
## 2091                               0.7621309
## 2092                               0.7456295
## 2093                               0.7929111
## 2094                               0.7639110
## 2095                               0.7486126
## 2096                               0.7821974
##      Party.fctr.RFE.X.BoxCox.rcv.glmnet.is.acc
## 2091                                     FALSE
## 2092                                     FALSE
## 2093                                     FALSE
## 2094                                     FALSE
## 2095                                     FALSE
## 2096                                     FALSE
##      Party.fctr.RFE.X.BoxCox.rcv.glmnet.err
## 2091                                   TRUE
## 2092                                   TRUE
## 2093                                   TRUE
## 2094                                   TRUE
## 2095                                   TRUE
## 2096                                   TRUE
##      Party.fctr.RFE.X.BoxCox.rcv.glmnet.err.abs
## 2091                                  0.7621309
## 2092                                  0.7456295
## 2093                                  0.7929111
## 2094                                  0.7639110
## 2095                                  0.7486126
## 2096                                  0.7821974
##      Party.fctr.All.X.range.rcv.glmnet
## 2091                                 R
## 2092                                 R
## 2093                                 R
## 2094                                 R
## 2095                                 R
## 2096                                 R
##      Party.fctr.All.X.range.rcv.glmnet.prob
## 2091                              0.7621309
## 2092                              0.7456295
## 2093                              0.7929111
## 2094                              0.7639110
## 2095                              0.7486126
## 2096                              0.7821974
##      Party.fctr.All.X.range.rcv.glmnet.is.acc
## 2091                                    FALSE
## 2092                                    FALSE
## 2093                                    FALSE
## 2094                                    FALSE
## 2095                                    FALSE
## 2096                                    FALSE
##      Party.fctr.All.X.range.rcv.glmnet.err
## 2091                                  TRUE
## 2092                                  TRUE
## 2093                                  TRUE
## 2094                                  TRUE
## 2095                                  TRUE
## 2096                                  TRUE
##      Party.fctr.All.X.range.rcv.glmnet.err.abs
## 2091                                 0.7621309
## 2092                                 0.7456295
## 2093                                 0.7929111
## 2094                                 0.7639110
## 2095                                 0.7486126
## 2096                                 0.7821974
##      Party.fctr.All.X.BoxCox.rcv.glmnet
## 2091                                  R
## 2092                                  R
## 2093                                  R
## 2094                                  R
## 2095                                  R
## 2096                                  R
##      Party.fctr.All.X.BoxCox.rcv.glmnet.prob
## 2091                               0.7621309
## 2092                               0.7456295
## 2093                               0.7929111
## 2094                               0.7639110
## 2095                               0.7486126
## 2096                               0.7821974
##      Party.fctr.All.X.BoxCox.rcv.glmnet.is.acc
## 2091                                     FALSE
## 2092                                     FALSE
## 2093                                     FALSE
## 2094                                     FALSE
## 2095                                     FALSE
## 2096                                     FALSE
##      Party.fctr.All.X.BoxCox.rcv.glmnet.err
## 2091                                   TRUE
## 2092                                   TRUE
## 2093                                   TRUE
## 2094                                   TRUE
## 2095                                   TRUE
## 2096                                   TRUE
##      Party.fctr.All.X.BoxCox.rcv.glmnet.err.abs
## 2091                                  0.7621309
## 2092                                  0.7456295
## 2093                                  0.7929111
## 2094                                  0.7639110
## 2095                                  0.7486126
## 2096                                  0.7821974
##      Party.fctr.RFE.X.center.scale.rcv.glmnet
## 2091                                        R
## 2092                                        R
## 2093                                        R
## 2094                                        R
## 2095                                        R
## 2096                                        R
##      Party.fctr.RFE.X.center.scale.rcv.glmnet.prob
## 2091                                     0.7621309
## 2092                                     0.7456295
## 2093                                     0.7929111
## 2094                                     0.7639110
## 2095                                     0.7486126
## 2096                                     0.7821974
##      Party.fctr.RFE.X.center.scale.rcv.glmnet.is.acc
## 2091                                           FALSE
## 2092                                           FALSE
## 2093                                           FALSE
## 2094                                           FALSE
## 2095                                           FALSE
## 2096                                           FALSE
##      Party.fctr.RFE.X.center.scale.rcv.glmnet.err
## 2091                                         TRUE
## 2092                                         TRUE
## 2093                                         TRUE
## 2094                                         TRUE
## 2095                                         TRUE
## 2096                                         TRUE
##      Party.fctr.RFE.X.center.scale.rcv.glmnet.err.abs
## 2091                                        0.7621309
## 2092                                        0.7456295
## 2093                                        0.7929111
## 2094                                        0.7639110
## 2095                                        0.7486126
## 2096                                        0.7821974
##      Party.fctr.All.X.center.scale.rcv.glmnet
## 2091                                        R
## 2092                                        R
## 2093                                        R
## 2094                                        R
## 2095                                        R
## 2096                                        R
##      Party.fctr.All.X.center.scale.rcv.glmnet.prob
## 2091                                     0.7621309
## 2092                                     0.7456295
## 2093                                     0.7929111
## 2094                                     0.7639110
## 2095                                     0.7486126
## 2096                                     0.7821974
##      Party.fctr.All.X.center.scale.rcv.glmnet.is.acc
## 2091                                           FALSE
## 2092                                           FALSE
## 2093                                           FALSE
## 2094                                           FALSE
## 2095                                           FALSE
## 2096                                           FALSE
##      Party.fctr.All.X.center.scale.rcv.glmnet.err
## 2091                                         TRUE
## 2092                                         TRUE
## 2093                                         TRUE
## 2094                                         TRUE
## 2095                                         TRUE
## 2096                                         TRUE
##      Party.fctr.All.X.center.scale.rcv.glmnet.err.abs
## 2091                                        0.7621309
## 2092                                        0.7456295
## 2093                                        0.7929111
## 2094                                        0.7639110
## 2095                                        0.7486126
## 2096                                        0.7821974
##      Party.fctr.All.X.zv.pca.rcv.glmnet
## 2091                                  R
## 2092                                  R
## 2093                                  R
## 2094                                  R
## 2095                                  R
## 2096                                  R
##      Party.fctr.All.X.zv.pca.rcv.glmnet.prob
## 2091                               0.7225761
## 2092                               0.7677672
## 2093                               0.7562057
## 2094                               0.7601074
## 2095                               0.7978404
## 2096                               0.8421323
##      Party.fctr.All.X.zv.pca.rcv.glmnet.is.acc
## 2091                                     FALSE
## 2092                                     FALSE
## 2093                                     FALSE
## 2094                                     FALSE
## 2095                                     FALSE
## 2096                                     FALSE
##      Party.fctr.All.X.zv.pca.rcv.glmnet.err
## 2091                                   TRUE
## 2092                                   TRUE
## 2093                                   TRUE
## 2094                                   TRUE
## 2095                                   TRUE
## 2096                                   TRUE
##      Party.fctr.All.X.zv.pca.rcv.glmnet.err.abs Party.fctr.RFE.X..rcv.gbm
## 2091                                  0.7225761                         R
## 2092                                  0.7677672                         R
## 2093                                  0.7562057                         R
## 2094                                  0.7601074                         R
## 2095                                  0.7978404                         R
## 2096                                  0.8421323                         R
##      Party.fctr.RFE.X..rcv.gbm.prob Party.fctr.RFE.X..rcv.gbm.is.acc
## 2091                      0.7365702                            FALSE
## 2092                      0.7283964                            FALSE
## 2093                      0.7591033                            FALSE
## 2094                      0.7595692                            FALSE
## 2095                      0.7561858                            FALSE
## 2096                      0.7370606                            FALSE
##      Party.fctr.RFE.X..rcv.gbm.err Party.fctr.RFE.X..rcv.gbm.err.abs
## 2091                          TRUE                         0.7365702
## 2092                          TRUE                         0.7283964
## 2093                          TRUE                         0.7591033
## 2094                          TRUE                         0.7595692
## 2095                          TRUE                         0.7561858
## 2096                          TRUE                         0.7370606
##      Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet
## 2091                                               R
## 2092                                               R
## 2093                                               R
## 2094                                               R
## 2095                                               R
## 2096                                               R
##      Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.prob
## 2091                                            0.6884009
## 2092                                            0.6687171
## 2093                                            0.7088661
## 2094                                            0.6940021
## 2095                                            0.7078276
## 2096                                            0.6746674
##      Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.is.acc
## 2091                                                  FALSE
## 2092                                                  FALSE
## 2093                                                  FALSE
## 2094                                                  FALSE
## 2095                                                  FALSE
## 2096                                                  FALSE
##      Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.err
## 2091                                                TRUE
## 2092                                                TRUE
## 2093                                                TRUE
## 2094                                                TRUE
## 2095                                                TRUE
## 2096                                                TRUE
##      Party.fctr.RFE.X.nzv.pca.spatialSign.rcv.glmnet.err.abs
## 2091                                               0.6884009
## 2092                                               0.6687171
## 2093                                               0.7088661
## 2094                                               0.6940021
## 2095                                               0.7078276
## 2096                                               0.6746674
##      Party.fctr.RFE.X..rcv.earth Party.fctr.RFE.X..rcv.earth.prob
## 2091                           R                        0.8427150
## 2092                           R                        0.8102211
## 2093                           R                        0.8398609
## 2094                           R                        0.8345596
## 2095                           R                        0.7973086
## 2096                           R                        0.8324029
##      Party.fctr.RFE.X..rcv.earth.is.acc Party.fctr.RFE.X..rcv.earth.err
## 2091                              FALSE                            TRUE
## 2092                              FALSE                            TRUE
## 2093                              FALSE                            TRUE
## 2094                              FALSE                            TRUE
## 2095                              FALSE                            TRUE
## 2096                              FALSE                            TRUE
##      Party.fctr.RFE.X..rcv.earth.err.abs Party.fctr.RFE.X..rcv.glm
## 2091                           0.8427150                         R
## 2092                           0.8102211                         R
## 2093                           0.8398609                         R
## 2094                           0.8345596                         R
## 2095                           0.7973086                         R
## 2096                           0.8324029                         R
##      Party.fctr.RFE.X..rcv.glm.prob Party.fctr.RFE.X..rcv.glm.is.acc
## 2091                      0.8577277                            FALSE
## 2092                      0.8946750                            FALSE
## 2093                      0.7871710                            FALSE
## 2094                      0.8035760                            FALSE
## 2095                      0.8072220                            FALSE
## 2096                      0.9706172                            FALSE
##      Party.fctr.RFE.X..rcv.glm.err Party.fctr.RFE.X..rcv.glm.err.abs
## 2091                          TRUE                         0.8577277
## 2092                          TRUE                         0.8946750
## 2093                          TRUE                         0.7871710
## 2094                          TRUE                         0.8035760
## 2095                          TRUE                         0.8072220
## 2096                          TRUE                         0.9706172
##      Party.fctr.All.X..rcv.glm Party.fctr.All.X..rcv.glm.prob
## 2091                         R                      0.8577640
## 2092                         R                      0.8928948
## 2093                         R                      0.7904827
## 2094                         R                      0.7980782
## 2095                         R                      0.8057473
## 2096                         R                      0.9763278
##      Party.fctr.All.X..rcv.glm.is.acc Party.fctr.All.X..rcv.glm.err
## 2091                            FALSE                          TRUE
## 2092                            FALSE                          TRUE
## 2093                            FALSE                          TRUE
## 2094                            FALSE                          TRUE
## 2095                            FALSE                          TRUE
## 2096                            FALSE                          TRUE
##      Party.fctr.All.X..rcv.glm.err.abs Party.fctr.RFE.X..rcv.rf
## 2091                         0.8577640                        D
## 2092                         0.8928948                        D
## 2093                         0.7904827                        R
## 2094                         0.7980782                        R
## 2095                         0.8057473                        D
## 2096                         0.9763278                        D
##      Party.fctr.RFE.X..rcv.rf.prob Party.fctr.RFE.X..rcv.rf.is.acc
## 2091                         0.296                            TRUE
## 2092                         0.290                            TRUE
## 2093                         0.748                           FALSE
## 2094                         0.756                           FALSE
## 2095                         0.254                            TRUE
## 2096                         0.634                            TRUE
##      Party.fctr.RFE.X..rcv.rf.err Party.fctr.RFE.X..rcv.rf.err.abs
## 2091                        FALSE                            0.296
## 2092                        FALSE                            0.290
## 2093                         TRUE                            0.748
## 2094                         TRUE                            0.756
## 2095                        FALSE                            0.254
## 2096                        FALSE                            0.634
##      Party.fctr.RFE.X..rcv.avNNet Party.fctr.RFE.X..rcv.avNNet.prob
## 2091                            R                         0.7823527
## 2092                            R                         0.6879154
## 2093                            R                         0.7823527
## 2094                            R                         0.7823527
## 2095                            R                         0.7823527
## 2096                            R                         0.7823527
##      Party.fctr.RFE.X..rcv.avNNet.is.acc Party.fctr.RFE.X..rcv.avNNet.err
## 2091                               FALSE                             TRUE
## 2092                               FALSE                             TRUE
## 2093                               FALSE                             TRUE
## 2094                               FALSE                             TRUE
## 2095                               FALSE                             TRUE
## 2096                               FALSE                             TRUE
##      Party.fctr.RFE.X..rcv.avNNet.err.abs Party.fctr.RFE.X..rcv.nnet
## 2091                            0.7823527                          R
## 2092                            0.6879154                          R
## 2093                            0.7823527                          D
## 2094                            0.7823527                          R
## 2095                            0.7823527                          R
## 2096                            0.7823527                          R
##      Party.fctr.RFE.X..rcv.nnet.prob Party.fctr.RFE.X..rcv.nnet.is.acc
## 2091                       0.7480462                             FALSE
## 2092                       0.7480114                             FALSE
## 2093                       0.5494767                              TRUE
## 2094                       0.7478350                             FALSE
## 2095                       0.7477999                             FALSE
## 2096                       0.7480751                             FALSE
##      Party.fctr.RFE.X..rcv.nnet.err Party.fctr.RFE.X..rcv.nnet.err.abs
## 2091                           TRUE                          0.7480462
## 2092                           TRUE                          0.7480114
## 2093                          FALSE                          0.5494767
## 2094                           TRUE                          0.7478350
## 2095                           TRUE                          0.7477999
## 2096                           TRUE                          0.7480751
##      Party.fctr.RFE.X.ica.rcv.glmnet Party.fctr.RFE.X.ica.rcv.glmnet.prob
## 2091                               D                            0.5188765
## 2092                               D                            0.4647875
## 2093                               D                            0.4884713
## 2094                               D                            0.4441462
## 2095                               D                            0.4834831
## 2096                               D                            0.4079638
##      Party.fctr.RFE.X.ica.rcv.glmnet.is.acc
## 2091                                   TRUE
## 2092                                   TRUE
## 2093                                   TRUE
## 2094                                   TRUE
## 2095                                   TRUE
## 2096                                   TRUE
##      Party.fctr.RFE.X.ica.rcv.glmnet.err
## 2091                               FALSE
## 2092                               FALSE
## 2093                               FALSE
## 2094                               FALSE
## 2095                               FALSE
## 2096                               FALSE
##      Party.fctr.RFE.X.ica.rcv.glmnet.err.abs
## 2091                               0.5188765
## 2092                               0.4647875
## 2093                               0.4884713
## 2094                               0.4441462
## 2095                               0.4834831
## 2096                               0.4079638
##      Party.fctr.All.X.ica.rcv.glmnet Party.fctr.All.X.ica.rcv.glmnet.prob
## 2091                               D                            0.5142442
## 2092                               D                            0.4691686
## 2093                               D                            0.4890337
## 2094                               D                            0.4473335
## 2095                               D                            0.4887993
## 2096                               D                            0.4080377
##      Party.fctr.All.X.ica.rcv.glmnet.is.acc
## 2091                                   TRUE
## 2092                                   TRUE
## 2093                                   TRUE
## 2094                                   TRUE
## 2095                                   TRUE
## 2096                                   TRUE
##      Party.fctr.All.X.ica.rcv.glmnet.err
## 2091                               FALSE
## 2092                               FALSE
## 2093                               FALSE
## 2094                               FALSE
## 2095                               FALSE
## 2096                               FALSE
##      Party.fctr.All.X.ica.rcv.glmnet.err.abs
## 2091                               0.5142442
## 2092                               0.4691686
## 2093                               0.4890337
## 2094                               0.4473335
## 2095                               0.4887993
## 2096                               0.4080377
##      Party.fctr.Interact.High.cor.Y..rcv.glmnet
## 2091                                          D
## 2092                                          D
## 2093                                          D
## 2094                                          D
## 2095                                          D
## 2096                                          R
##      Party.fctr.Interact.High.cor.Y..rcv.glmnet.prob
## 2091                                       0.6287407
## 2092                                       0.6462271
## 2093                                       0.6174662
## 2094                                       0.5772760
## 2095                                       0.6411002
## 2096                                       0.7198149
##      Party.fctr.Interact.High.cor.Y..rcv.glmnet.is.acc
## 2091                                              TRUE
## 2092                                              TRUE
## 2093                                              TRUE
## 2094                                              TRUE
## 2095                                              TRUE
## 2096                                             FALSE
##      Party.fctr.Interact.High.cor.Y..rcv.glmnet.err
## 2091                                          FALSE
## 2092                                          FALSE
## 2093                                          FALSE
## 2094                                          FALSE
## 2095                                          FALSE
## 2096                                           TRUE
##      Party.fctr.Interact.High.cor.Y..rcv.glmnet.err.abs
## 2091                                          0.6287407
## 2092                                          0.6462271
## 2093                                          0.6174662
## 2094                                          0.5772760
## 2095                                          0.6411002
## 2096                                          0.7198149
##      Party.fctr.Ensemble.auto.2..rcv.glmnet.prob
## 2091                                   0.8568837
## 2092                                   0.8449626
## 2093                                          NA
## 2094                                          NA
## 2095                                   0.8733823
## 2096                                          NA
##      Party.fctr.Ensemble.auto.2..rcv.glmnet
## 2091                                      R
## 2092                                      R
## 2093                                   <NA>
## 2094                                   <NA>
## 2095                                      R
## 2096                                   <NA>
##      Party.fctr.Ensemble.auto.2..rcv.glmnet.err
## 2091                                       TRUE
## 2092                                       TRUE
## 2093                                         NA
## 2094                                         NA
## 2095                                       TRUE
## 2096                                         NA
##      Party.fctr.Ensemble.auto.2..rcv.glmnet.err.abs
## 2091                                      0.8568837
## 2092                                      0.8449626
## 2093                                             NA
## 2094                                             NA
## 2095                                      0.8733823
## 2096                                             NA
##      Party.fctr.Ensemble.auto.2..rcv.glmnet.is.acc
## 2091                                         FALSE
## 2092                                         FALSE
## 2093                                            NA
## 2094                                            NA
## 2095                                         FALSE
## 2096                                            NA
##      Party.fctr.Final.RFE.X.Inc..rcv.bagEarth.prob
## 2091                                     0.8366347
## 2092                                     0.8362552
## 2093                                     0.8384290
## 2094                                     0.8350554
## 2095                                     0.8394247
## 2096                                     0.8442049
##      Party.fctr.Final.RFE.X.Inc..rcv.bagEarth
## 2091                                        R
## 2092                                        R
## 2093                                        R
## 2094                                        R
## 2095                                        R
## 2096                                        R
##      Party.fctr.Final.RFE.X.Inc..rcv.bagEarth.err
## 2091                                         TRUE
## 2092                                         TRUE
## 2093                                         TRUE
## 2094                                         TRUE
## 2095                                         TRUE
## 2096                                         TRUE
##      Party.fctr.Final.RFE.X.Inc..rcv.bagEarth.err.abs
## 2091                                        0.8366347
## 2092                                        0.8362552
## 2093                                        0.8384290
## 2094                                        0.8350554
## 2095                                        0.8394247
## 2096                                        0.8442049
##      Party.fctr.Final.RFE.X.Inc..rcv.bagEarth.is.acc
## 2091                                           FALSE
## 2092                                           FALSE
## 2093                                           FALSE
## 2094                                           FALSE
## 2095                                           FALSE
## 2096                                           FALSE
##      Party.fctr.Final.All.X.ica.rcv.glmnet.prob
## 2091                                  0.5142442
## 2092                                  0.4691686
## 2093                                  0.4890337
## 2094                                  0.4473335
## 2095                                  0.4887993
## 2096                                  0.4080377
##      Party.fctr.Final.All.X.ica.rcv.glmnet
## 2091                                     D
## 2092                                     D
## 2093                                     D
## 2094                                     D
## 2095                                     D
## 2096                                     D
##      Party.fctr.Final.All.X.ica.rcv.glmnet.err
## 2091                                     FALSE
## 2092                                     FALSE
## 2093                                     FALSE
## 2094                                     FALSE
## 2095                                     FALSE
## 2096                                     FALSE
##      Party.fctr.Final.All.X.ica.rcv.glmnet.err.abs
## 2091                                     0.5142442
## 2092                                     0.4691686
## 2093                                     0.4890337
## 2094                                     0.4473335
## 2095                                     0.4887993
## 2096                                     0.4080377
##      Party.fctr.Final.All.X.ica.rcv.glmnet.is.acc
## 2091                                         TRUE
## 2092                                         TRUE
## 2093                                         TRUE
## 2094                                         TRUE
## 2095                                         TRUE
## 2096                                         TRUE
##      Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.prob
## 2091                                         0.8566931
## 2092                                         0.8593542
## 2093                                         0.8595136
## 2094                                         0.8599621
## 2095                                         0.8601832
## 2096                                         0.8682690
##      Party.fctr.Final.Ensemble.auto.2..rcv.glmnet
## 2091                                            R
## 2092                                            R
## 2093                                            R
## 2094                                            R
## 2095                                            R
## 2096                                            R
##      Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.err
## 2091                                             TRUE
## 2092                                             TRUE
## 2093                                             TRUE
## 2094                                             TRUE
## 2095                                             TRUE
## 2096                                             TRUE
##      Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.err.abs
## 2091                                            0.8566931
## 2092                                            0.8593542
## 2093                                            0.8595136
## 2094                                            0.8599621
## 2095                                            0.8601832
## 2096                                            0.8682690
##      Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.is.acc
## 2091                                               FALSE
## 2092                                               FALSE
## 2093                                               FALSE
## 2094                                               FALSE
## 2095                                               FALSE
## 2096                                               FALSE
##      Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.accurate
## 2091                                                 FALSE
## 2092                                                 FALSE
## 2093                                                 FALSE
## 2094                                                 FALSE
## 2095                                                 FALSE
## 2096                                                 FALSE
##      Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.error
## 2091                                          0.2066931
## 2092                                          0.2093542
## 2093                                          0.2095136
## 2094                                          0.2099621
## 2095                                          0.2101832
## 2096                                          0.2182690

dsp_feats_vctr <- c(NULL)
for(var in grep(".imp", names(glb_feats_df), fixed=TRUE, value=TRUE))
    dsp_feats_vctr <- union(dsp_feats_vctr, 
                            glb_feats_df[!is.na(glb_feats_df[, var]), "id"])

# print(glbObsTrn[glbObsTrn$UniqueID %in% FN_OOB_ids, 
#                     grep(glb_rsp_var, names(glbObsTrn), value=TRUE)])

print(setdiff(names(glbObsTrn), names(glbObsAll)))
##  [1] "Party.fctr.Final.RFE.X.Inc..rcv.bagEarth.prob"       
##  [2] "Party.fctr.Final.RFE.X.Inc..rcv.bagEarth"            
##  [3] "Party.fctr.Final.RFE.X.Inc..rcv.bagEarth.err"        
##  [4] "Party.fctr.Final.RFE.X.Inc..rcv.bagEarth.err.abs"    
##  [5] "Party.fctr.Final.RFE.X.Inc..rcv.bagEarth.is.acc"     
##  [6] "Party.fctr.Final.All.X.ica.rcv.glmnet.prob"          
##  [7] "Party.fctr.Final.All.X.ica.rcv.glmnet"               
##  [8] "Party.fctr.Final.All.X.ica.rcv.glmnet.err"           
##  [9] "Party.fctr.Final.All.X.ica.rcv.glmnet.err.abs"       
## [10] "Party.fctr.Final.All.X.ica.rcv.glmnet.is.acc"        
## [11] "Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.prob"   
## [12] "Party.fctr.Final.Ensemble.auto.2..rcv.glmnet"        
## [13] "Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.err"    
## [14] "Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.err.abs"
## [15] "Party.fctr.Final.Ensemble.auto.2..rcv.glmnet.is.acc"
for (col in setdiff(names(glbObsTrn), names(glbObsAll)))
    # Merge or cbind ?
    glbObsAll[glbObsAll$.src == "Train", col] <- glbObsTrn[, col]

print(setdiff(names(glbObsFit), names(glbObsAll)))
## character(0)
print(setdiff(names(glbObsOOB), names(glbObsAll)))
## character(0)
for (col in setdiff(names(glbObsOOB), names(glbObsAll)))
    # Merge or cbind ?
    glbObsAll[glbObsAll$.lcn == "OOB", col] <- glbObsOOB[, col]
    
print(setdiff(names(glbObsNew), names(glbObsAll)))
## character(0)
#glb2Sav(); all.equal(savObsAll, glbObsAll); all.equal(sav_models_lst, glb_models_lst)
#load(file = paste0(glbOut$pfx, "dsk_knitr.RData"))
#cmpCols <- names(glbObsAll)[!grepl("\\.Final\\.", names(glbObsAll))]; all.equal(savObsAll[, cmpCols], glbObsAll[, cmpCols]); all.equal(savObsAll[, "H.P.http"], glbObsAll[, "H.P.http"]); 

replay.petrisim(pn = glb_analytics_pn, 
    replay.trans = (glb_analytics_avl_objs <- c(glb_analytics_avl_objs, 
        "data.training.all.prediction","model.final")), flip_coord = TRUE)
## time trans    "bgn " "fit.data.training.all " "predict.data.new " "end " 
## 0.0000   multiple enabled transitions:  data.training.all data.new model.selected    firing:  model.selected 
## 1.0000    3   2 1 0 0 
## 1.0000   multiple enabled transitions:  data.training.all data.new model.selected model.final data.training.all.prediction   firing:  data.training.all.prediction 
## 2.0000    5   2 0 0 1
## Warning in replay.petrisim(pn = glb_analytics_pn, replay.trans =
## (glb_analytics_avl_objs <- c(glb_analytics_avl_objs, : Transition:
## model.final not enabled; adding missing token(s)
## Warning in replay.petrisim(pn = glb_analytics_pn, replay.trans
## = (glb_analytics_avl_objs <- c(glb_analytics_avl_objs, : Place:
## fit.data.training.all: added 1 missing token
## 2.0000   multiple enabled transitions:  data.training.all data.new model.selected model.final data.training.all.prediction   firing:  model.final 
## 3.0000    4   2 0 1 1

glb_chunks_df <- myadd_chunk(glb_chunks_df, "predict.data.new", major.inc = TRUE)
##               label step_major step_minor label_minor      bgn      end
## 4 fit.data.training          2          1           1 1668.862 1778.672
## 5  predict.data.new          3          0           0 1778.673       NA
##   elapsed
## 4  109.81
## 5      NA

Step 3.0: predict data new

## Warning: Removed 1392 rows containing missing values (geom_point).

## Warning: Removed 1392 rows containing missing values (geom_point).

## Warning: Removed 1392 rows containing missing values (geom_point).

## Warning: Removed 1392 rows containing missing values (geom_point).

## NULL
## Loading required package: tidyr
## 
## Attaching package: 'tidyr'
## The following object is masked from 'package:Matrix':
## 
##     expand
## [1] "OOBobs total range outliers: 0"
## [1] "newobs total range outliers: 0"
## [1] 0.65
## [1] "glbMdlSelId: Ensemble.auto.2##rcv#glmnet"
## [1] "glbMdlFinId: Final.Ensemble.auto.2##rcv#glmnet"
## [1] "Cross Validation issues:"
## Final.RFE.X.Inc##rcv#bagEarth 
##                             0
##                                      max.Accuracy.OOB max.AUCROCR.OOB
## Ensemble.auto.2##rcv#glmnet                 0.5883408       0.5840502
## Final.Ensemble.auto.2##rcv#glmnet           0.5883408       0.5840502
## Ensemble.auto.1##rcv#glmnet                 0.5856502       0.5840728
## RFE.X.Inc##rcv#bagEarth                     0.5838565       0.5840728
## RFE.X##rcv#bagEarth                         0.5838565       0.5829523
## RFE.X#zv.pca#rcv#glmnet                     0.5829596       0.5816510
## All.X#nzv.spatialSign#rcv#glmnet            0.5820628       0.5787416
## All.X#spatialSign#rcv#glmnet                0.5811659       0.5793099
## RFE.X#nzv.spatialSign#rcv#glmnet            0.5811659       0.5785672
## All.X.Inc#nzv.spatialSign#rcv#glmnet        0.5811659       0.5734523
## RFE.X#spatialSign#rcv#glmnet                0.5802691       0.5794035
## All.X#nzv#rcv#glmnet                        0.5775785       0.5766539
## RFE.X#nzv#rcv#glmnet                        0.5775785       0.5762019
## All.X#expoTrans#rcv#glmnet                  0.5775785       0.5745421
## RFE.X#expoTrans#rcv#glmnet                  0.5775785       0.5745421
## All.X#YeoJohnson#rcv#glmnet                 0.5775785       0.5744824
## RFE.X#YeoJohnson#rcv#glmnet                 0.5775785       0.5744824
## RFE.X##rcv#rpart                            0.5775785       0.5547284
## RFE.X##rcv#glmnet                           0.5766816       0.5757966
## All.X#conditionalX#rcv#glmnet               0.5766816       0.5757966
## All.X##rcv#glmnet                           0.5766816       0.5757966
## Low.cor.X##rcv#glmnet                       0.5766816       0.5757966
## RFE.X#conditionalX#rcv#glmnet               0.5766816       0.5757966
## All.X#zv#rcv#glmnet                         0.5766816       0.5757966
## RFE.X#zv#rcv#glmnet                         0.5766816       0.5757966
## RFE.X#scale#rcv#glmnet                      0.5766816       0.5757966
## RFE.X#center#rcv#glmnet                     0.5766816       0.5757966
## All.X#scale#rcv#glmnet                      0.5766816       0.5757966
## All.X#center#rcv#glmnet                     0.5766816       0.5757966
## RFE.X#range#rcv#glmnet                      0.5766816       0.5757966
## RFE.X#BoxCox#rcv#glmnet                     0.5766816       0.5757966
## All.X#range#rcv#glmnet                      0.5766816       0.5757966
## All.X#BoxCox#rcv#glmnet                     0.5766816       0.5757966
## RFE.X#center.scale#rcv#glmnet               0.5766816       0.5757966
## All.X#center.scale#rcv#glmnet               0.5766816       0.5757966
## All.X#zv.pca#rcv#glmnet                     0.5748879       0.5798104
## RFE.X##rcv#gbm                              0.5730942       0.5783993
## Ensemble.auto.2##adaptive_cv#glmnet         0.5730942       0.5594251
## RFE.X#nzv.pca.spatialSign#rcv#glmnet        0.5713004       0.5742305
## Ensemble.auto.3##rcv#glmnet                 0.5695067       0.5609040
## RFE.X##rcv#earth                            0.5677130       0.5720864
## RFE.X##rcv#glm                              0.5668161       0.5690413
## Ensemble.auto.2##cv#glmnet                  0.5659193       0.5560006
## Ensemble.auto.2##LGOCV#glmnet               0.5659193       0.5560006
## Ensemble.auto.6##rcv#glmnet                 0.5659193       0.5560006
## Ensemble.auto.8##rcv#glmnet                 0.5659193       0.5560006
## Ensemble.auto.7##rcv#glmnet                 0.5659193       0.5560006
## Ensemble.auto.9##rcv#glmnet                 0.5659193       0.5560006
## Ensemble.auto.11##rcv#glmnet                0.5659193       0.5560006
## Ensemble.auto.12##rcv#glmnet                0.5659193       0.5560006
## Ensemble.auto.10##rcv#glmnet                0.5659193       0.5560006
## Ensemble.auto.13##rcv#glmnet                0.5659193       0.5560006
## Ensemble.auto.14##rcv#glmnet                0.5659193       0.5560006
## Ensemble.auto.15##rcv#glmnet                0.5659193       0.5560006
## Ensemble.auto.2##boot#glmnet                0.5659193       0.5560006
## Ensemble.auto.2##boot632#glmnet             0.5659193       0.5560006
## All.X##rcv#glm                              0.5650224       0.5687249
## RFE.X##rcv#rf                               0.5650224       0.5510859
## RFE.X##rcv#avNNet                           0.5632287       0.5713598
## Ensemble.auto.4##rcv#glmnet                 0.5632287       0.5536838
## RFE.X##rcv#nnet                             0.5623318       0.5667713
## Ensemble.auto.5##rcv#glmnet                 0.5623318       0.5556826
## RFE.X#ica#rcv#glmnet                        0.5363229       0.5370894
## All.X#ica#rcv#glmnet                        0.5354260       0.5360626
## Interact.High.cor.Y##rcv#glmnet             0.5345291       0.5242069
## Random###myrandom_classfr                   0.5300448       0.5181895
## Max.cor.Y.rcv.1X1###glmnet                  0.5300448       0.5102459
## Max.cor.Y##rcv#rpart                        0.5300448       0.5000646
## MFO###myMFO_classfr                         0.5300448       0.5000000
## Final.All.X#ica#rcv#glmnet                         NA              NA
## Final.RFE.X.Inc##rcv#bagEarth                      NA              NA
##                                      max.AUCpROC.OOB
## Ensemble.auto.2##rcv#glmnet                0.5667761
## Final.Ensemble.auto.2##rcv#glmnet          0.5667761
## Ensemble.auto.1##rcv#glmnet                0.5677303
## RFE.X.Inc##rcv#bagEarth                    0.5671007
## RFE.X##rcv#bagEarth                        0.5601161
## RFE.X#zv.pca#rcv#glmnet                    0.5792308
## All.X#nzv.spatialSign#rcv#glmnet           0.5572148
## All.X#spatialSign#rcv#glmnet               0.5570372
## RFE.X#nzv.spatialSign#rcv#glmnet           0.5597528
## All.X.Inc#nzv.spatialSign#rcv#glmnet       0.5556503
## RFE.X#spatialSign#rcv#glmnet               0.5570372
## All.X#nzv#rcv#glmnet                       0.5550900
## RFE.X#nzv#rcv#glmnet                       0.5531816
## All.X#expoTrans#rcv#glmnet                 0.5559554
## RFE.X#expoTrans#rcv#glmnet                 0.5559554
## All.X#YeoJohnson#rcv#glmnet                0.5559554
## RFE.X#YeoJohnson#rcv#glmnet                0.5559554
## RFE.X##rcv#rpart                           0.5677723
## RFE.X##rcv#glmnet                          0.5588180
## All.X#conditionalX#rcv#glmnet              0.5588180
## All.X##rcv#glmnet                          0.5588180
## Low.cor.X##rcv#glmnet                      0.5588180
## RFE.X#conditionalX#rcv#glmnet              0.5588180
## All.X#zv#rcv#glmnet                        0.5588180
## RFE.X#zv#rcv#glmnet                        0.5588180
## RFE.X#scale#rcv#glmnet                     0.5588180
## RFE.X#center#rcv#glmnet                    0.5588180
## All.X#scale#rcv#glmnet                     0.5588180
## All.X#center#rcv#glmnet                    0.5588180
## RFE.X#range#rcv#glmnet                     0.5588180
## RFE.X#BoxCox#rcv#glmnet                    0.5588180
## All.X#range#rcv#glmnet                     0.5588180
## All.X#BoxCox#rcv#glmnet                    0.5588180
## RFE.X#center.scale#rcv#glmnet              0.5588180
## All.X#center.scale#rcv#glmnet              0.5588180
## All.X#zv.pca#rcv#glmnet                    0.5717247
## RFE.X##rcv#gbm                             0.5638748
## Ensemble.auto.2##adaptive_cv#glmnet        0.5501802
## RFE.X#nzv.pca.spatialSign#rcv#glmnet       0.5545298
## Ensemble.auto.3##rcv#glmnet                0.5510956
## RFE.X##rcv#earth                           0.5641493
## RFE.X##rcv#glm                             0.5497475
## Ensemble.auto.2##cv#glmnet                 0.5521580
## Ensemble.auto.2##LGOCV#glmnet              0.5521580
## Ensemble.auto.6##rcv#glmnet                0.5521580
## Ensemble.auto.8##rcv#glmnet                0.5521580
## Ensemble.auto.7##rcv#glmnet                0.5521580
## Ensemble.auto.9##rcv#glmnet                0.5521580
## Ensemble.auto.11##rcv#glmnet               0.5521580
## Ensemble.auto.12##rcv#glmnet               0.5521580
## Ensemble.auto.10##rcv#glmnet               0.5521580
## Ensemble.auto.13##rcv#glmnet               0.5521580
## Ensemble.auto.14##rcv#glmnet               0.5521580
## Ensemble.auto.15##rcv#glmnet               0.5521580
## Ensemble.auto.2##boot#glmnet               0.5521580
## Ensemble.auto.2##boot632#glmnet            0.5521580
## All.X##rcv#glm                             0.5487933
## RFE.X##rcv#rf                              0.5382083
## RFE.X##rcv#avNNet                          0.5593589
## Ensemble.auto.4##rcv#glmnet                0.5491679
## RFE.X##rcv#nnet                            0.5584628
## Ensemble.auto.5##rcv#glmnet                0.5401861
## RFE.X#ica#rcv#glmnet                       0.5121737
## All.X#ica#rcv#glmnet                       0.5133442
## Interact.High.cor.Y##rcv#glmnet            0.5218093
## Random###myrandom_classfr                  0.4836608
## Max.cor.Y.rcv.1X1###glmnet                 0.4999322
## Max.cor.Y##rcv#rpart                       0.4999322
## MFO###myMFO_classfr                        0.5000000
## Final.All.X#ica#rcv#glmnet                        NA
## Final.RFE.X.Inc##rcv#bagEarth                     NA
##                                      min.elapsedtime.everything
## Ensemble.auto.2##rcv#glmnet                               2.362
## Final.Ensemble.auto.2##rcv#glmnet                         2.362
## Ensemble.auto.1##rcv#glmnet                               2.493
## RFE.X.Inc##rcv#bagEarth                                1752.739
## RFE.X##rcv#bagEarth                                     884.423
## RFE.X#zv.pca#rcv#glmnet                                  74.676
## All.X#nzv.spatialSign#rcv#glmnet                         52.416
## All.X#spatialSign#rcv#glmnet                             36.885
## RFE.X#nzv.spatialSign#rcv#glmnet                         51.794
## All.X.Inc#nzv.spatialSign#rcv#glmnet                     67.172
## RFE.X#spatialSign#rcv#glmnet                             46.699
## All.X#nzv#rcv#glmnet                                     36.115
## RFE.X#nzv#rcv#glmnet                                     34.109
## All.X#expoTrans#rcv#glmnet                               70.569
## RFE.X#expoTrans#rcv#glmnet                               71.462
## All.X#YeoJohnson#rcv#glmnet                              58.542
## RFE.X#YeoJohnson#rcv#glmnet                              84.187
## RFE.X##rcv#rpart                                         15.749
## RFE.X##rcv#glmnet                                        21.949
## All.X#conditionalX#rcv#glmnet                            22.580
## All.X##rcv#glmnet                                        22.609
## Low.cor.X##rcv#glmnet                                    22.775
## RFE.X#conditionalX#rcv#glmnet                            23.022
## All.X#zv#rcv#glmnet                                      23.568
## RFE.X#zv#rcv#glmnet                                      24.269
## RFE.X#scale#rcv#glmnet                                   25.649
## RFE.X#center#rcv#glmnet                                  25.755
## All.X#scale#rcv#glmnet                                   26.279
## All.X#center#rcv#glmnet                                  26.891
## RFE.X#range#rcv#glmnet                                   27.116
## RFE.X#BoxCox#rcv#glmnet                                  28.258
## All.X#range#rcv#glmnet                                   28.776
## All.X#BoxCox#rcv#glmnet                                  29.405
## RFE.X#center.scale#rcv#glmnet                            29.657
## All.X#center.scale#rcv#glmnet                            30.287
## All.X#zv.pca#rcv#glmnet                                  77.239
## RFE.X##rcv#gbm                                           81.851
## Ensemble.auto.2##adaptive_cv#glmnet                       5.425
## RFE.X#nzv.pca.spatialSign#rcv#glmnet                    533.967
## Ensemble.auto.3##rcv#glmnet                               3.061
## RFE.X##rcv#earth                                        166.648
## RFE.X##rcv#glm                                           12.435
## Ensemble.auto.2##cv#glmnet                                2.656
## Ensemble.auto.2##LGOCV#glmnet                             2.757
## Ensemble.auto.6##rcv#glmnet                               2.971
## Ensemble.auto.8##rcv#glmnet                               3.096
## Ensemble.auto.7##rcv#glmnet                               3.146
## Ensemble.auto.9##rcv#glmnet                               3.219
## Ensemble.auto.11##rcv#glmnet                              3.455
## Ensemble.auto.12##rcv#glmnet                              3.472
## Ensemble.auto.10##rcv#glmnet                              3.676
## Ensemble.auto.13##rcv#glmnet                              3.698
## Ensemble.auto.14##rcv#glmnet                              3.855
## Ensemble.auto.15##rcv#glmnet                              3.881
## Ensemble.auto.2##boot#glmnet                              5.048
## Ensemble.auto.2##boot632#glmnet                           7.233
## All.X##rcv#glm                                           14.312
## RFE.X##rcv#rf                                            83.830
## RFE.X##rcv#avNNet                                       182.550
## Ensemble.auto.4##rcv#glmnet                               2.831
## RFE.X##rcv#nnet                                          90.316
## Ensemble.auto.5##rcv#glmnet                               3.313
## RFE.X#ica#rcv#glmnet                                     39.908
## All.X#ica#rcv#glmnet                                     41.240
## Interact.High.cor.Y##rcv#glmnet                           5.284
## Random###myrandom_classfr                                 0.265
## Max.cor.Y.rcv.1X1###glmnet                                0.753
## Max.cor.Y##rcv#rpart                                      1.624
## MFO###myMFO_classfr                                       0.399
## Final.All.X#ica#rcv#glmnet                               52.873
## Final.RFE.X.Inc##rcv#bagEarth                          1094.474
##                                      max.Accuracy.fit
## Ensemble.auto.2##rcv#glmnet                 0.6846348
## Final.Ensemble.auto.2##rcv#glmnet           0.6846348
## Ensemble.auto.1##rcv#glmnet                 0.6842608
## RFE.X.Inc##rcv#bagEarth                     0.6169886
## RFE.X##rcv#bagEarth                         0.6288811
## RFE.X#zv.pca#rcv#glmnet                     0.6459313
## All.X#nzv.spatialSign#rcv#glmnet            0.6478785
## All.X#spatialSign#rcv#glmnet                0.6492270
## RFE.X#nzv.spatialSign#rcv#glmnet            0.6462317
## All.X.Inc#nzv.spatialSign#rcv#glmnet        0.6440612
## RFE.X#spatialSign#rcv#glmnet                0.6490772
## All.X#nzv#rcv#glmnet                        0.6475806
## RFE.X#nzv#rcv#glmnet                        0.6466826
## All.X#expoTrans#rcv#glmnet                  0.6463076
## RFE.X#expoTrans#rcv#glmnet                  0.6462327
## All.X#YeoJohnson#rcv#glmnet                 0.6465321
## RFE.X#YeoJohnson#rcv#glmnet                 0.6466820
## RFE.X##rcv#rpart                            0.6207805
## RFE.X##rcv#glmnet                           0.6475052
## All.X#conditionalX#rcv#glmnet               0.6471308
## All.X##rcv#glmnet                           0.6471308
## Low.cor.X##rcv#glmnet                       0.6471308
## RFE.X#conditionalX#rcv#glmnet               0.6475052
## All.X#zv#rcv#glmnet                         0.6471308
## RFE.X#zv#rcv#glmnet                         0.6475052
## RFE.X#scale#rcv#glmnet                      0.6475052
## RFE.X#center#rcv#glmnet                     0.6475052
## All.X#scale#rcv#glmnet                      0.6471308
## All.X#center#rcv#glmnet                     0.6471308
## RFE.X#range#rcv#glmnet                      0.6475052
## RFE.X#BoxCox#rcv#glmnet                     0.6475052
## All.X#range#rcv#glmnet                      0.6471308
## All.X#BoxCox#rcv#glmnet                     0.6471308
## RFE.X#center.scale#rcv#glmnet               0.6475052
## All.X#center.scale#rcv#glmnet               0.6471308
## All.X#zv.pca#rcv#glmnet                     0.6421158
## RFE.X##rcv#gbm                              0.6477310
## Ensemble.auto.2##adaptive_cv#glmnet         1.0000000
## RFE.X#nzv.pca.spatialSign#rcv#glmnet        0.6480297
## Ensemble.auto.3##rcv#glmnet                 1.0000000
## RFE.X##rcv#earth                            0.6400213
## RFE.X##rcv#glm                              0.6255716
## Ensemble.auto.2##cv#glmnet                  1.0000000
## Ensemble.auto.2##LGOCV#glmnet               1.0000000
## Ensemble.auto.6##rcv#glmnet                 1.0000000
## Ensemble.auto.8##rcv#glmnet                 1.0000000
## Ensemble.auto.7##rcv#glmnet                 1.0000000
## Ensemble.auto.9##rcv#glmnet                 1.0000000
## Ensemble.auto.11##rcv#glmnet                1.0000000
## Ensemble.auto.12##rcv#glmnet                1.0000000
## Ensemble.auto.10##rcv#glmnet                1.0000000
## Ensemble.auto.13##rcv#glmnet                1.0000000
## Ensemble.auto.14##rcv#glmnet                1.0000000
## Ensemble.auto.15##rcv#glmnet                1.0000000
## Ensemble.auto.2##boot#glmnet                1.0000000
## Ensemble.auto.2##boot632#glmnet             1.0000000
## All.X##rcv#glm                              0.6254219
## RFE.X##rcv#rf                               1.0000000
## RFE.X##rcv#avNNet                           0.6367252
## Ensemble.auto.4##rcv#glmnet                 1.0000000
## RFE.X##rcv#nnet                             0.6155403
## Ensemble.auto.5##rcv#glmnet                 1.0000000
## RFE.X#ica#rcv#glmnet                        0.5603719
## All.X#ica#rcv#glmnet                        0.5607462
## Interact.High.cor.Y##rcv#glmnet             0.6250526
## Random###myrandom_classfr                   0.5299798
## Max.cor.Y.rcv.1X1###glmnet                  0.6240737
## Max.cor.Y##rcv#rpart                        0.6227308
## MFO###myMFO_classfr                         0.5299798
## Final.All.X#ica#rcv#glmnet                  0.5525619
## Final.RFE.X.Inc##rcv#bagEarth               0.6646911
##                                      opt.prob.threshold.fit
## Ensemble.auto.2##rcv#glmnet                            0.50
## Final.Ensemble.auto.2##rcv#glmnet                      0.50
## Ensemble.auto.1##rcv#glmnet                            0.50
## RFE.X.Inc##rcv#bagEarth                                0.50
## RFE.X##rcv#bagEarth                                    0.50
## RFE.X#zv.pca#rcv#glmnet                                0.50
## All.X#nzv.spatialSign#rcv#glmnet                       0.50
## All.X#spatialSign#rcv#glmnet                           0.50
## RFE.X#nzv.spatialSign#rcv#glmnet                       0.50
## All.X.Inc#nzv.spatialSign#rcv#glmnet                   0.50
## RFE.X#spatialSign#rcv#glmnet                           0.50
## All.X#nzv#rcv#glmnet                                   0.50
## RFE.X#nzv#rcv#glmnet                                   0.50
## All.X#expoTrans#rcv#glmnet                             0.50
## RFE.X#expoTrans#rcv#glmnet                             0.50
## All.X#YeoJohnson#rcv#glmnet                            0.50
## RFE.X#YeoJohnson#rcv#glmnet                            0.50
## RFE.X##rcv#rpart                                       0.50
## RFE.X##rcv#glmnet                                      0.50
## All.X#conditionalX#rcv#glmnet                          0.50
## All.X##rcv#glmnet                                      0.50
## Low.cor.X##rcv#glmnet                                  0.50
## RFE.X#conditionalX#rcv#glmnet                          0.50
## All.X#zv#rcv#glmnet                                    0.50
## RFE.X#zv#rcv#glmnet                                    0.50
## RFE.X#scale#rcv#glmnet                                 0.50
## RFE.X#center#rcv#glmnet                                0.50
## All.X#scale#rcv#glmnet                                 0.50
## All.X#center#rcv#glmnet                                0.50
## RFE.X#range#rcv#glmnet                                 0.50
## RFE.X#BoxCox#rcv#glmnet                                0.50
## All.X#range#rcv#glmnet                                 0.50
## All.X#BoxCox#rcv#glmnet                                0.50
## RFE.X#center.scale#rcv#glmnet                          0.50
## All.X#center.scale#rcv#glmnet                          0.50
## All.X#zv.pca#rcv#glmnet                                0.50
## RFE.X##rcv#gbm                                         0.50
## Ensemble.auto.2##adaptive_cv#glmnet                    0.50
## RFE.X#nzv.pca.spatialSign#rcv#glmnet                   0.50
## Ensemble.auto.3##rcv#glmnet                            0.50
## RFE.X##rcv#earth                                       0.50
## RFE.X##rcv#glm                                         0.50
## Ensemble.auto.2##cv#glmnet                             0.50
## Ensemble.auto.2##LGOCV#glmnet                          0.50
## Ensemble.auto.6##rcv#glmnet                            0.50
## Ensemble.auto.8##rcv#glmnet                            0.50
## Ensemble.auto.7##rcv#glmnet                            0.50
## Ensemble.auto.9##rcv#glmnet                            0.50
## Ensemble.auto.11##rcv#glmnet                           0.50
## Ensemble.auto.12##rcv#glmnet                           0.50
## Ensemble.auto.10##rcv#glmnet                           0.50
## Ensemble.auto.13##rcv#glmnet                           0.50
## Ensemble.auto.14##rcv#glmnet                           0.50
## Ensemble.auto.15##rcv#glmnet                           0.50
## Ensemble.auto.2##boot#glmnet                           0.50
## Ensemble.auto.2##boot632#glmnet                        0.50
## All.X##rcv#glm                                         0.50
## RFE.X##rcv#rf                                          0.50
## RFE.X##rcv#avNNet                                      0.50
## Ensemble.auto.4##rcv#glmnet                            0.50
## RFE.X##rcv#nnet                                        0.50
## Ensemble.auto.5##rcv#glmnet                            0.50
## RFE.X#ica#rcv#glmnet                                   0.50
## All.X#ica#rcv#glmnet                                   0.50
## Interact.High.cor.Y##rcv#glmnet                        0.50
## Random###myrandom_classfr                              0.55
## Max.cor.Y.rcv.1X1###glmnet                             0.45
## Max.cor.Y##rcv#rpart                                   0.50
## MFO###myMFO_classfr                                    0.50
## Final.All.X#ica#rcv#glmnet                             0.50
## Final.RFE.X.Inc##rcv#bagEarth                          0.50
##                                      opt.prob.threshold.OOB
## Ensemble.auto.2##rcv#glmnet                            0.65
## Final.Ensemble.auto.2##rcv#glmnet                      0.65
## Ensemble.auto.1##rcv#glmnet                            0.65
## RFE.X.Inc##rcv#bagEarth                                0.60
## RFE.X##rcv#bagEarth                                    0.60
## RFE.X#zv.pca#rcv#glmnet                                0.50
## All.X#nzv.spatialSign#rcv#glmnet                       0.60
## All.X#spatialSign#rcv#glmnet                           0.60
## RFE.X#nzv.spatialSign#rcv#glmnet                       0.60
## All.X.Inc#nzv.spatialSign#rcv#glmnet                   0.60
## RFE.X#spatialSign#rcv#glmnet                           0.60
## All.X#nzv#rcv#glmnet                                   0.60
## RFE.X#nzv#rcv#glmnet                                   0.55
## All.X#expoTrans#rcv#glmnet                             0.55
## RFE.X#expoTrans#rcv#glmnet                             0.55
## All.X#YeoJohnson#rcv#glmnet                            0.55
## RFE.X#YeoJohnson#rcv#glmnet                            0.55
## RFE.X##rcv#rpart                                       0.50
## RFE.X##rcv#glmnet                                      0.55
## All.X#conditionalX#rcv#glmnet                          0.55
## All.X##rcv#glmnet                                      0.55
## Low.cor.X##rcv#glmnet                                  0.55
## RFE.X#conditionalX#rcv#glmnet                          0.55
## All.X#zv#rcv#glmnet                                    0.55
## RFE.X#zv#rcv#glmnet                                    0.55
## RFE.X#scale#rcv#glmnet                                 0.55
## RFE.X#center#rcv#glmnet                                0.55
## All.X#scale#rcv#glmnet                                 0.55
## All.X#center#rcv#glmnet                                0.55
## RFE.X#range#rcv#glmnet                                 0.55
## RFE.X#BoxCox#rcv#glmnet                                0.55
## All.X#range#rcv#glmnet                                 0.55
## All.X#BoxCox#rcv#glmnet                                0.55
## RFE.X#center.scale#rcv#glmnet                          0.55
## All.X#center.scale#rcv#glmnet                          0.55
## All.X#zv.pca#rcv#glmnet                                0.50
## RFE.X##rcv#gbm                                         0.60
## Ensemble.auto.2##adaptive_cv#glmnet                    0.70
## RFE.X#nzv.pca.spatialSign#rcv#glmnet                   0.55
## Ensemble.auto.3##rcv#glmnet                            0.55
## RFE.X##rcv#earth                                       0.60
## RFE.X##rcv#glm                                         0.65
## Ensemble.auto.2##cv#glmnet                             0.60
## Ensemble.auto.2##LGOCV#glmnet                          0.60
## Ensemble.auto.6##rcv#glmnet                            0.60
## Ensemble.auto.8##rcv#glmnet                            0.60
## Ensemble.auto.7##rcv#glmnet                            0.60
## Ensemble.auto.9##rcv#glmnet                            0.60
## Ensemble.auto.11##rcv#glmnet                           0.60
## Ensemble.auto.12##rcv#glmnet                           0.60
## Ensemble.auto.10##rcv#glmnet                           0.60
## Ensemble.auto.13##rcv#glmnet                           0.60
## Ensemble.auto.14##rcv#glmnet                           0.60
## Ensemble.auto.15##rcv#glmnet                           0.60
## Ensemble.auto.2##boot#glmnet                           0.60
## Ensemble.auto.2##boot632#glmnet                        0.60
## All.X##rcv#glm                                         0.65
## RFE.X##rcv#rf                                          0.65
## RFE.X##rcv#avNNet                                      0.65
## Ensemble.auto.4##rcv#glmnet                            0.60
## RFE.X##rcv#nnet                                        0.65
## Ensemble.auto.5##rcv#glmnet                            0.60
## RFE.X#ica#rcv#glmnet                                   0.55
## All.X#ica#rcv#glmnet                                   0.55
## Interact.High.cor.Y##rcv#glmnet                        0.70
## Random###myrandom_classfr                              0.55
## Max.cor.Y.rcv.1X1###glmnet                             0.65
## Max.cor.Y##rcv#rpart                                   0.65
## MFO###myMFO_classfr                                    0.50
## Final.All.X#ica#rcv#glmnet                               NA
## Final.RFE.X.Inc##rcv#bagEarth                            NA
## [1] "Ensemble.auto.2##rcv#glmnet OOB confusion matrix & accuracy: "
##          Prediction
## Reference   D   R
##         D 505  86
##         R 373 151
##     err.abs.fit.sum err.abs.OOB.sum err.abs.trn.sum err.abs.new.sum
## Yes        158.8865        84.95637        260.8742              NA
## NA         799.4847       205.99749       1008.0114              NA
## No         836.2324       234.16301       1075.4652              NA
##     .freqRatio.Fit .freqRatio.OOB .freqRatio.Tst .n.Fit .n.New.D .n.New.R
## Yes      0.1675275      0.1605381      0.1602011    746      223       NA
## NA       0.3920952      0.3928251      0.3929598   1746      535       12
## No       0.4403773      0.4466368      0.4468391   1961      380      242
##     .n.OOB .n.Trn.D .n.Trn.R .n.Tst .n.fit .n.new .n.trn err.abs.OOB.mean
## Yes    179      742      183    223    746    223    925        0.4746166
## NA     438     1171     1013    547   1746    547   2184        0.4703139
## No     498     1038     1421    622   1961    622   2459        0.4702069
##     err.abs.fit.mean err.abs.new.mean err.abs.trn.mean
## Yes        0.2129845               NA        0.2820261
## NA         0.4578950               NA        0.4615437
## No         0.4264316               NA        0.4373587
##  err.abs.fit.sum  err.abs.OOB.sum  err.abs.trn.sum  err.abs.new.sum 
##      1794.603578       525.116866      2344.350754               NA 
##   .freqRatio.Fit   .freqRatio.OOB   .freqRatio.Tst           .n.Fit 
##         1.000000         1.000000         1.000000      4453.000000 
##         .n.New.D         .n.New.R           .n.OOB         .n.Trn.D 
##      1138.000000               NA      1115.000000      2951.000000 
##         .n.Trn.R           .n.Tst           .n.fit           .n.new 
##      2617.000000      1392.000000      4453.000000      1392.000000 
##           .n.trn err.abs.OOB.mean err.abs.fit.mean err.abs.new.mean 
##      5568.000000         1.415137         1.097311               NA 
## err.abs.trn.mean 
##         1.180929
## [1] "Features Importance for selected models:"
##                                         Ensemble.auto.2..rcv.glmnet.imp
## Party.fctr.RFE.X.Inc..rcv.bagEarth.prob                             100
## [1] "glbObsNew prediction stats:"
## 
##    D    R 
## 1138  254
##                  label step_major step_minor label_minor      bgn      end
## 5     predict.data.new          3          0           0 1778.673 1798.497
## 6 display.session.info          4          0           0 1798.498       NA
##   elapsed
## 5  19.825
## 6      NA

Null Hypothesis (\(\sf{H_{0}}\)): mpg is not impacted by am_fctr.
The variance by am_fctr appears to be independent. #{r q1, cache=FALSE} # print(t.test(subset(cars_df, am_fctr == "automatic")$mpg, # subset(cars_df, am_fctr == "manual")$mpg, # var.equal=FALSE)$conf) # We reject the null hypothesis i.e. we have evidence to conclude that am_fctr impacts mpg (95% confidence). Manual transmission is better for miles per gallon versus automatic transmission.

##               label step_major step_minor label_minor      bgn      end
## 3 fit.data.training          2          0           0  455.508 1668.861
## 1      fit.models_2          1          0           0    7.063  428.025
## 4 fit.data.training          2          1           1 1668.862 1778.672
## 2        fit.models          1          1           1  428.026  455.507
## 5  predict.data.new          3          0           0 1778.673 1798.497
##    elapsed duration
## 3 1213.353 1213.353
## 1  420.962  420.962
## 4  109.810  109.810
## 2   27.482   27.481
## 5   19.825   19.824
## [1] "Total Elapsed Time: 1,798.497 secs"